00010000:00010000:3.0F:1788985533.471300:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1788985534.495357:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1788985535.525516:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788985535.605787:0:56449:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcba639e20 20000000:00000080:3.0:1788985535.605803:0:56449:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b114232a000 uarg=0000000000000000 00010000:00010000:3.0:1788985535.606775:0:56449:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788985535.606812:0:56449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b1248494600) 00010000:00010000:3.0:1788985535.606817:0:56449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788985535.606828:0:56449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b12463c7a00/0xa0dd3253da53046f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xbe077727b9e171e1 expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985535.606851:0:56449:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1142cc6000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788985535.606878:0:56449:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788985535.606889:0:56449:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788985535.606916:0:56449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788985535.606956:0:56449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985535.606971:0:56449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b12463c6800/0xa0dd3253da530461 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da53045a expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985535.606977:0:56449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985535.607014:0:56449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b12463c6800/0xa0dd3253da530461 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0dd3253da53045a expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985535.607027:0:56449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b12463c6800/0xa0dd3253da530461 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0dd3253da53045a expref: 23 pid: 6506 timeout: 1475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985535.607041:0:56449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1250acb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:56449:1875885973675136:0@lo:104: 00000100:00100000:3.0:1788985535.607102:0:56449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985535.607152:0:56449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b126ea9f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788985535.607375:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973675136 00000100:00100000:0.0:1788985535.607384:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973675136 00000100:00100000:0.0:1788985535.607430:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788985535.607440:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1250ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:18d53938-9833-4a4f-b2bc-80656579f00f+3:56449:x1875885973675136:12345-0@lo:104: 00010000:00010000:0.0:1788985535.607463:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff8b12677e9c00/0xa0dd3253da53045a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da530461 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607530:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985535.607536:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1250ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:18d53938-9833-4a4f-b2bc-80656579f00f+3:56449:x1875885973675136:12345-0@lo:104: Request processed in 98us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985535.607543:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00010000:00010000:0.0:1788985535.607565:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985535.607570:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff8b12677e9c00/0xa0dd3253da53045a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da530461 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607577:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12677e9c00 already unused, calling callback (ffffffffc13e9c20) 10000000:00010000:0.0:1788985535.607581:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff8b12677e9c00/0xa0dd3253da53045a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0dd3253da530461 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607588:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff8b12677e9c00/0xa0dd3253da53045a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0dd3253da530461 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788985535.607595:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff8b12677e9c00/0xa0dd3253da53045a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0dd3253da530461 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985535.607600:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788985535.607628:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff8b12677e9c00/0xa0dd3253da53045a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da530461 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607634:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788985535.607660:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff8b12677e9c00/0xa0dd3253da53045a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da530461 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607666:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff8b12677e9c00/0xa0dd3253da53045a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da530461 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607679:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985535.607681:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985535.607683:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985535.607702:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114305ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:18d53938-9833-4a4f-b2bc-80656579f00f:3642:1875885973675264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985535.607730:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985535.607765:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973675264 00000100:00100000:0.0:1788985535.607769:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973675264 00010000:00010000:0.0:1788985535.607786:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b12463c6800/0xa0dd3253da530461 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da53045a expref: 24 pid: 6506 timeout: 1475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985535.607808:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788985535.607814:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114305ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18d53938-9833-4a4f-b2bc-80656579f00f+24:3642:x1875885973675264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985535.607823:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985535.607828:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b12463c6800/0xa0dd3253da530461 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da53045a expref: 24 pid: 6506 timeout: 1475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607837:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b12463c6800/0xa0dd3253da530461 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0dd3253da53045a expref: 24 pid: 6506 timeout: 1475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607850:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607858:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607881:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607889:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607896:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607902:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607908:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12463c6200 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:0.0:1788985535.607912:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.607918:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.608043:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985535.608053:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788985535.608169:0:56449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12463c6800/0xa0dd3253da530461 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0dd3253da53045a expref: 24 pid: 6506 timeout: 1475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985535.608253:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114305ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18d53938-9833-4a4f-b2bc-80656579f00f+24:3642:x1875885973675264:12345-0@lo:103:ldlm_bl.0 Request processed in 439us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985535.608260:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788985535.608596:0:56449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1250acb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:56449:1875885973675136:0@lo:104: 00010000:00010000:3.0:1788985535.608613:0:56449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985535.608622:0:56449:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985535.608628:0:56449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985535.608633:0:56449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12463c6200/0xa0dd3253da53048b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0F:1788985535.611720:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114305ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:18d53938-9833-4a4f-b2bc-80656579f00f:3642:1875885973675264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788985535.710724:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114305c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973675392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788985535.710801:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985535.710881:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788985535.710888:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973675520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788985535.710913:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985535.710970:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973675392 00000100:00100000:0.0:1788985535.710979:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973675392 00000100:00100000:0.0:1788985535.711037:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973675520 00000100:00100000:0.0:1788985535.711041:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973675520 00000100:00100000:0.0:1788985535.711069:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1788985535.711078:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1250acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973675392:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788985535.711086:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1788985535.711094:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1250ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973675520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788985535.711106:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1788985535.711106:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788985535.711153:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1250ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973675520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985535.711153:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1250acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973675392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985535.711160:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00080000:3.0:1788985535.711300:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788985535.711337:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973675520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788985535.711370:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114305c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973675392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788985535.711788:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1788985536.222198:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114305e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973675648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788985536.222298:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985536.222344:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973675648 00000100:00100000:1.0:1788985536.222355:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973675648 00000100:00100000:1.0:1788985536.222424:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1788985536.222437:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973675648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788985536.222489:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788985536.222551:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973675648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985536.222560:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:2.0:1788985536.222589:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114305e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973675648:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1788985536.354812:0:56497:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff1d959720 20000000:00000080:1.0:1788985536.354836:0:56497:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b1277e8d000 uarg=0000000000000000 00010000:00010000:1.0:1788985536.355189:0:56497:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985536.355210:0:56497:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985536.355231:0:56497:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985536.355242:0:56497:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788985536.355268:0:56497:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985536.355294:0:56497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12617eb200/0xa0dd3253da530492 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 56497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985536.355313:0:56497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12617eb200/0xa0dd3253da530492 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 56497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985536.355339:0:56497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617eb200/0xa0dd3253da530492 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985536.355347:0:56497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617eb200/0xa0dd3253da530492 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985536.355354:0:56497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12617eb200/0xa0dd3253da530492 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985536.355432:0:56497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12617eb200/0xa0dd3253da530492 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985536.355440:0:56497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12617eb200 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:1.0:1788985536.355454:0:56497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12617eb200/0xa0dd3253da530492 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985536.355465:0:56497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12617eb200/0xa0dd3253da530492 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 56497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985536.355480:0:56497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12617eb200/0xa0dd3253da530492 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985536.355490:0:56497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12617eb200/0xa0dd3253da530492 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985536.355497:0:56497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12617eb200/0xa0dd3253da530492 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985536.543806:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788985536.798038:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788985536.798050:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b1262230000 from 1 10000000:01000000:0.0:1788985536.798058:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788985536.798135:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985536.798150:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985536.798164:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985536.798195:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114305d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973675776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788985536.798289:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985536.798702:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973675776 00000100:00100000:2.0:1788985536.798713:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973675776 00000100:00100000:2.0:1788985536.798774:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:2.0:1788985536.798784:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1267768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18d53938-9833-4a4f-b2bc-80656579f00f+23:6511:x1875885973675776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985536.798800:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985536.798816:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b11433ea800/0xa0dd3253da5304a0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0dd3253da530499 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985536.798842:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b11433ea800/0xa0dd3253da5304a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0dd3253da530499 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985536.798853:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b11433ea800/0xa0dd3253da5304a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da530499 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985536.798863:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b11433ea800, rc 0) 00000100:00100000:2.0:1788985536.798901:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1267768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18d53938-9833-4a4f-b2bc-80656579f00f+24:6511:x1875885973675776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985536.798907:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:0.0:1788985536.799057:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b11410b1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788985536.799086:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114305d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973675776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985536.799104:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5304a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985536.799115:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0dd3253da5304a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985536.799137:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788985536.799164:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5304a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985536.799173:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5304a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788985537.332540:0:56545:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff4a96e310 20000000:00000080:0.0:1788985537.332567:0:56545:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b114386a800 uarg=0000000000000000 00010000:00010000:0.0:1788985537.332815:0:56545:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788985537.332836:0:56545:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788985537.332859:0:56545:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788985537.332871:0:56545:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788985537.332899:0:56545:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985537.334068:0:56545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985537.334176:0:56545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b11433ea800/0xa0dd3253da5304a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da530499 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985537.334189:0:56545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985537.334248:0:56545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b11433ea800/0xa0dd3253da5304a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0dd3253da530499 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985537.334268:0:56545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b11433ea800/0xa0dd3253da5304a0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0dd3253da530499 expref: 23 pid: 6509 timeout: 1477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985537.334287:0:56545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114305d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:56545:1875885973675904:0@lo:104: 00000100:00100000:0.0:1788985537.334377:0:56545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985537.334553:0:56545:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b11410b1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788985537.336022:0:26567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973675904 00000100:00100000:2.0:1788985537.336036:0:26567:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973675904 00000100:00100000:3.0:1788985537.337666:0:26567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788985537.337683:0:26567:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114305ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:18d53938-9833-4a4f-b2bc-80656579f00f+3:56545:x1875885973675904:12345-0@lo:104: 00010000:00010000:3.0:1788985537.337709:0:26567:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da5304a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985537.337855:0:26567:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788985537.337862:0:26567:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114305ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:18d53938-9833-4a4f-b2bc-80656579f00f+3:56545:x1875885973675904:12345-0@lo:104: Request processed in 184us (3486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985537.337871:0:26567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00010000:00010000:2.0:1788985537.338290:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985537.338299:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da5304a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.338308:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12677e8c00 already unused, calling callback (ffffffffc13e9c20) 10000000:00010000:2.0:1788985537.338323:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0dd3253da5304a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.338333:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0dd3253da5304a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985537.338341:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0dd3253da5304a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985537.338348:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985537.338402:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da5304a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.338409:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985537.338450:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da5304a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.338458:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530499 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da5304a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.338477:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985537.338479:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985537.338481:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985537.338490:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788985537.338510:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:18d53938-9833-4a4f-b2bc-80656579f00f:3641:1875885973676032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985537.338562:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985537.338616:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973676032 00000100:00100000:2.0:1788985537.338626:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973676032 00010000:00010000:2.0:1788985537.338654:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b11433ea800/0xa0dd3253da5304a0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da530499 expref: 24 pid: 6509 timeout: 1477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985537.338695:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788985537.338703:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18d53938-9833-4a4f-b2bc-80656579f00f+24:3641:x1875885973676032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985537.338718:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985537.338725:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b11433ea800/0xa0dd3253da5304a0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da530499 expref: 24 pid: 6509 timeout: 1477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.338737:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b11433ea800/0xa0dd3253da5304a0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0dd3253da530499 expref: 24 pid: 6509 timeout: 1477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339294:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339307:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339330:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339338:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339346:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339353:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339359:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12677e8e00 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:2.0:1788985537.339364:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339381:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339390:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339403:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985537.339468:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18d53938-9833-4a4f-b2bc-80656579f00f+24:3641:x1875885973676032:12345-0@lo:103:ldlm_bl.0 Request processed in 766us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985537.339476:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788985537.339529:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:18d53938-9833-4a4f-b2bc-80656579f00f:3641:1875885973676032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985537.339594:0:56545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b11433ea800/0xa0dd3253da5304a0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0dd3253da530499 expref: 23 pid: 6509 timeout: 1477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985537.339606:0:56545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114305d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:56545:1875885973675904:0@lo:104: 00010000:00010000:2.0:1788985537.339621:0:56545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339631:0:56545:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339637:0:56545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.339643:0:56545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304a7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985537.570208:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985537.593764:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788985537.593808:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788985537.593833:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788985537.593862:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953230464 00000100:00100000:0.0:1788985537.593874:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953230464 00000100:00100000:0.0:1788985537.594020:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953230336 00000100:00100000:0.0:1788985537.594024:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953230336 00000100:00100000:0.0:1788985537.594066:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1757 00000100:00100000:0.0:1788985537.594078:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114305d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2390:x1875885953230464:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788985537.594170:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114305d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2390:x1875885953230464:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 94us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985537.594178:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1757 00000100:00100000:0.0:1788985537.594199:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1758 00000100:00100000:0.0:1788985537.594205:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114305e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2390:x1875885953230336:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788985537.594231:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114305e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2390:x1875885953230336:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985537.594237:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1758 00000100:00080000:0.0:1788985537.594269:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788985537.594274:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788985537.596204:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953230208 00000100:00100000:1.0:1788985537.596226:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953230208 00000100:00100000:1.0:1788985537.596305:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 899 00000100:00100000:1.0:1788985537.596316:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126776a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2390:x1875885953230208:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788985537.596395:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126776a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2390:x1875885953230208:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 81us (2646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985537.596402:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 899 00000100:00100000:0.0:1788985537.759170:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973676160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985537.759267:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985537.759458:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973676160 00000100:00100000:1.0:1788985537.759469:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973676160 00000100:00100000:1.0:1788985537.759542:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1788985537.759552:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114305c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973676160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985537.759587:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788985537.759651:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114305c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973676160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985537.759659:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00080000:0.0:1788985537.759759:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985537.759802:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973676160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985537.760726:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114305ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973676288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788985537.760773:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985537.760828:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973676288 00000100:00100000:0.0:1788985537.760835:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973676288 00000100:00100000:0.0:1788985537.760879:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1788985537.760887:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114305df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973676288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788985537.760906:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788985537.760964:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114305df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973676288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985537.760971:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00080000:0.0:1788985537.760990:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985537.761015:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114305ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973676288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788985537.761797:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114407d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973676416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788985537.761841:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985537.761919:0:13641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973676416 00000100:00100000:1.0:1788985537.761949:0:13641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973676416 00000100:00100000:1.0:1788985537.761990:0:13641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1788985537.761998:0:13641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114305ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973676416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788985537.762029:0:13641:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788985537.762068:0:13641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114305ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973676416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985537.762074:0:13641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:0.0:1788985537.762154:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114407d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973676416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788985537.763571:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788985537.769728:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1250acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875885973676672:0@lo:400:kworker.0 00000100:00100000:1.0:1788985537.769839:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985537.769921:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788985537.769947:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1250acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973676800:0@lo:400:kworker.0 00000100:00100000:1.0:1788985537.769990:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985537.770032:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973676672 00000100:00100000:1.0:1788985537.770041:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973676672 00000100:00100000:1.0:1788985537.770111:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1759 00000100:00100000:1.0:1788985537.770122:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114407e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875885973676672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985537.770186:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114407e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875885973676672:12345-0@lo:400:kworker.0 Request processed in 66us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985537.770193:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1759 00000100:00100000:1.0:1788985537.770220:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973676800 00000100:00100000:1.0:1788985537.770223:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973676800 00000100:00100000:1.0:1788985537.770251:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1788985537.770258:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114407fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973676800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985537.770293:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114407fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973676800:12345-0@lo:400:kworker.0 Request processed in 35us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985537.770299:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1788985537.770362:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1250acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973676800:0@lo:400:kworker.0 00000100:00100000:1.0:1788985537.770376:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1250acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875885973676672:0@lo:400:kworker.0 00000100:00100000:0.0:1788985537.770642:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875885973676928:0@lo:400:kworker.0 00000100:00100000:0.0:1788985537.770678:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985537.770713:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1250aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875885973676544:0@lo:400:kworker.0 00000100:00100000:0.0:1788985537.770737:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985537.770761:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973676928 00000100:00100000:0.0:1788985537.770765:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973676928 00000100:00100000:0.0:1788985537.770802:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973676544 00000100:00100000:0.0:1788985537.770805:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973676544 00000100:00100000:0.0:1788985537.770825:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760 00000100:00100000:0.0:1788985537.770832:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114305c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875885973676928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985537.770867:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114305c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875885973676928:12345-0@lo:400:kworker.0 Request processed in 35us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985537.770885:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760 00000100:00100000:0.0:1788985537.770898:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1761 00000100:00100000:0.0:1788985537.770905:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875885973676544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985537.770958:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875885973676544:12345-0@lo:400:kworker.0 Request processed in 53us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985537.770965:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1761 00000100:00080000:0.0:1788985537.770981:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985537.771006:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1250aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875885973676544:0@lo:400:kworker.0 00000100:00100000:0.0:1788985537.771023:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875885973676928:0@lo:400:kworker.0 00000100:00100000:3.0:1788985537.772848:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973677184:0@lo:400:kworker.0 00000100:00100000:3.0:1788985537.772954:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985537.773008:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788985537.773014:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973677312:0@lo:400:kworker.0 00000100:00100000:3.0:1788985537.773037:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985537.773070:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973677184 00000100:00100000:3.0:1788985537.773077:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973677184 00000100:00100000:3.0:1788985537.773134:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973677312 00000100:00100000:3.0:1788985537.773137:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973677312 00000100:00100000:3.0:1788985537.773163:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1788985537.773172:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973677184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985537.773228:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973677184:12345-0@lo:400:kworker.0 Request processed in 57us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985537.773236:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1788985537.773256:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:3.0:1788985537.773262:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973677312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985537.773287:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973677312:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985537.773293:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1788985537.773469:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875885973677056:0@lo:400:kworker.0 00000100:00100000:1.0:1788985537.773508:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985537.773536:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875885973677568:0@lo:400:kworker.0 00000100:00100000:1.0:1788985537.773560:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985537.773578:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788985537.773584:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875885973677440:0@lo:400:kworker.0 00000100:00100000:1.0:1788985537.773618:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788985537.774023:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985537.774039:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973677056 00000100:00100000:0.0:1788985537.774044:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973677056 00000100:00100000:0.0:1788985537.774099:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973677568 00000100:00100000:0.0:1788985537.774102:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973677568 00000100:00100000:0.0:1788985537.774124:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973677440 00000100:00100000:0.0:1788985537.774127:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973677440 00000100:00100000:0.0:1788985537.774145:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762 00000100:00100000:0.0:1788985537.774153:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875885973677056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985537.774201:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875885973677056:12345-0@lo:400:kworker.0 Request processed in 49us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985537.774208:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762 00000100:00100000:0.0:1788985537.774222:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1763 00000100:00100000:0.0:1788985537.774228:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114407dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875885973677568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985537.774258:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114407dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875885973677568:12345-0@lo:400:kworker.0 Request processed in 30us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985537.774274:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1763 00000100:00100000:0.0:1788985537.774287:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1764 00000100:00100000:0.0:1788985537.774292:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875885973677440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985537.774324:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875885973677440:12345-0@lo:400:kworker.0 Request processed in 32us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985537.774330:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1764 00000100:00080000:1.0:1788985537.774422:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788985537.774445:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788985537.774507:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875885973677440:0@lo:400:kworker.0 00010000:00080000:0.0:1788985537.774524:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b11422e6a00 x1875885973677056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788985537.774536:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875885973677056:0@lo:400:kworker.0 00010000:00080000:0.0:1788985537.774547:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b11422e6d80 x1875885973677568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788985537.774557:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875885973677568:0@lo:400:kworker.0 00000100:00100000:3.0:1788985537.775006:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973677312:0@lo:400:kworker.0 00000100:00100000:3.0:1788985537.775035:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973677184:0@lo:400:kworker.0 00010000:00010000:0.0:1788985538.601666:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788985539.166216:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788985539.166228:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b1262230000 from 1 10000000:01000000:0.0:1788985539.166236:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788985539.166310:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985539.166326:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985539.166350:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985539.166410:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973677696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788985539.166520:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985539.166678:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973677696 00000100:00100000:3.0:1788985539.166688:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973677696 00000100:00100000:3.0:1788985539.166760:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1788985539.166771:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1267768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+23:6511:x1875885973677696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788985539.166789:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788985539.166805:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b12463c6800/0xa0dd3253da5304b5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0dd3253da5304ae expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985539.166836:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12463c6800/0xa0dd3253da5304b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0dd3253da5304ae expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985539.166848:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b12463c6800/0xa0dd3253da5304b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da5304ae expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985539.166859:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b12463c6800, rc 0) 00000100:00100000:3.0:1788985539.166900:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1267768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+24:6511:x1875885973677696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985539.166908:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:0.0:1788985539.167368:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b125824e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788985539.167397:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973677696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985539.167417:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5304b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985539.167447:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0dd3253da5304b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985539.167472:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788985539.167477:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5304b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985539.167485:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5304b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985539.615529:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985540.642163:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985540.831306:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973677824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788985540.831368:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985540.831453:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973677824 00000100:00100000:3.0:1788985540.831461:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973677824 00000100:00100000:3.0:1788985540.831523:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:3.0:1788985540.831534:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973677824:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788985540.831969:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788985540.834518:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788985540.834611:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973677824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3077us (3239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985540.834632:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:3.0:1788985540.834673:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973677952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788985540.834710:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985540.834794:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973677824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985540.835942:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973677952 00000100:00100000:0.0:1788985540.835951:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973677952 00000100:00100000:0.0:1788985540.836016:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1788985540.836025:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973677952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788985540.836044:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788985540.836100:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973677952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985540.836107:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:3.0:1788985540.836203:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973677952:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788985540.836360:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788985541.346698:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788985541.346723:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973678080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788985541.346794:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985541.347081:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973678080 00000100:00100000:1.0:1788985541.347090:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973678080 00000100:00100000:1.0:1788985541.347136:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:1.0:1788985541.347146:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973678080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788985541.347180:0:6519:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788985541.347230:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973678080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985541.347237:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:1.0:1788985541.347279:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973678080:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788985541.664978:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788985541.894767:0:56741:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc77fbc730 20000000:00000080:0.0:1788985541.894794:0:56741:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b1143870c00 uarg=0000000000000000 00010000:00010000:0.0:1788985541.895010:0:56741:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788985541.895027:0:56741:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788985541.895047:0:56741:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788985541.895058:0:56741:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788985541.895078:0:56741:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985541.895099:0:56741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985541.895117:0:56741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b12463c6800/0xa0dd3253da5304b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da5304ae expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985541.895125:0:56741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985541.895176:0:56741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b12463c6800/0xa0dd3253da5304b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0dd3253da5304ae expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985541.895190:0:56741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b12463c6800/0xa0dd3253da5304b5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0dd3253da5304ae expref: 23 pid: 6506 timeout: 1481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985541.895205:0:56741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:56741:1875885973678208:0@lo:104: 00000100:00100000:0.0:1788985541.895277:0:56741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985541.895609:0:56741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b12677c7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788985541.895900:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788985541.895915:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973678208 00000100:00100000:1.0:1788985541.895922:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973678208 00000100:00100000:1.0:1788985541.896114:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788985541.896124:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11421a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:18d53938-9833-4a4f-b2bc-80656579f00f+3:56741:x1875885973678208:12345-0@lo:104: 00010000:00010000:1.0:1788985541.896138:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da5304b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.896284:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788985541.896291:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11421a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:18d53938-9833-4a4f-b2bc-80656579f00f+3:56741:x1875885973678208:12345-0@lo:104: Request processed in 169us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985541.896299:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00010000:2.0:1788985541.896380:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985541.896388:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da5304b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985541.896406:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12677e8000 already unused, calling callback (ffffffffc13e9c20) 10000000:00010000:2.0:1788985541.896410:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0dd3253da5304b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985541.896418:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0dd3253da5304b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985541.896425:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0dd3253da5304b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985541.896431:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985541.896468:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da5304b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985541.896475:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985541.896496:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da5304b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985541.896503:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff8b12677e8000/0xa0dd3253da5304ae lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da5304b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985541.896529:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985541.896531:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985541.896533:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985541.896541:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788985541.896553:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:18d53938-9833-4a4f-b2bc-80656579f00f:3641:1875885973678336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985541.896585:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985541.896685:0:56741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:56741:1875885973678208:0@lo:104: 00010000:00010000:0.0:1788985541.896704:0:56741:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985541.896778:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973678336 00000100:00100000:1.0:1788985541.896783:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973678336 00010000:00010000:1.0:1788985541.896801:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b12463c6800/0xa0dd3253da5304b5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da5304ae expref: 24 pid: 6506 timeout: 1481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985541.896831:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788985541.896845:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18d53938-9833-4a4f-b2bc-80656579f00f+24:3641:x1875885973678336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985541.896857:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788985541.896863:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b12463c6800/0xa0dd3253da5304b5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da5304ae expref: 24 pid: 6506 timeout: 1481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.896874:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b12463c6800/0xa0dd3253da5304b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0dd3253da5304ae expref: 24 pid: 6506 timeout: 1481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.896886:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12463c6800/0xa0dd3253da5304b5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0dd3253da5304ae expref: 24 pid: 6506 timeout: 1481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.896901:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.896910:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.896950:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.896959:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.896966:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.896972:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.896978:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12677e8e00 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:1.0:1788985541.896982:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.896996:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.897023:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985541.897033:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788985541.897065:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18d53938-9833-4a4f-b2bc-80656579f00f+23:3641:x1875885973678336:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985541.897072:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788985541.897098:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:18d53938-9833-4a4f-b2bc-80656579f00f:3641:1875885973678336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985541.897167:0:56741:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985541.897176:0:56741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985541.897182:0:56741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304bc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985542.687041:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985542.720052:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788985542.720092:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788985542.720129:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788985542.720183:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953230592 00000100:00100000:0.0:1788985542.720193:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953230592 00000100:00100000:0.0:1788985542.720322:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 901 00000100:00100000:0.0:1788985542.720334:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126776b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2391:x1875885953230592:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788985542.720417:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126776b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2391:x1875885953230592:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 85us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985542.720425:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 901 00000100:00100000:0.0:1788985542.720458:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953230720 00000100:00100000:0.0:1788985542.720462:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953230720 00000100:00100000:0.0:1788985542.720494:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953230848 00000100:00100000:0.0:1788985542.720497:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953230848 00000100:00100000:0.0:1788985542.720516:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1765 00000100:00100000:0.0:1788985542.720523:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2390:x1875885953230720:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788985542.720552:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2390:x1875885953230720:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985542.720558:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1765 00000100:00100000:0.0:1788985542.720570:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1766 00000100:00100000:0.0:1788985542.720577:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2391:x1875885953230848:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788985542.720600:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2391:x1875885953230848:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985542.720606:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1766 00000100:00080000:0.0:1788985542.720723:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788985542.720728:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788985542.878105:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788985542.878129:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973678464:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.878202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.878269:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973678464 00000100:00100000:3.0:1788985542.878278:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973678464 00000100:00100000:3.0:1788985542.878323:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:3.0:1788985542.878332:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1267769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18d53938-9833-4a4f-b2bc-80656579f00f+23:3640:x1875885973678464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.878375:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1267769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18d53938-9833-4a4f-b2bc-80656579f00f+23:3640:x1875885973678464:12345-0@lo:400:kworker.0 Request processed in 45us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.878382:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:3.0:1788985542.878438:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973678464:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.878467:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875885973678592:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.878501:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.878526:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973678592 00000100:00100000:3.0:1788985542.878529:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973678592 00000100:00100000:3.0:1788985542.878562:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1767 00000100:00100000:3.0:1788985542.878580:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875885973678592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.878611:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875885973678592:12345-0@lo:400:kworker.0 Request processed in 32us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.878617:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1767 00000100:00100000:3.0:1788985542.878642:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875885973678592:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.878671:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973678720:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.878693:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.878719:0:13641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973678720 00000100:00100000:3.0:1788985542.878722:0:13641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973678720 00000100:00100000:3.0:1788985542.878741:0:13641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1788985542.878746:0:13641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973678720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.878774:0:13641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973678720:12345-0@lo:400:kworker.0 Request processed in 28us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.878780:0:13641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1788985542.878800:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973678720:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.878822:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875885973678848:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.878842:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.878873:0:10354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973678848 00000100:00100000:3.0:1788985542.878876:0:10354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973678848 00000100:00100000:3.0:1788985542.878895:0:10354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1768 00000100:00100000:3.0:1788985542.878899:0:10354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875885973678848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.878947:0:10354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875885973678848:12345-0@lo:400:kworker.0 Request processed in 26us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.878953:0:10354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1768 00000100:00100000:3.0:1788985542.878979:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875885973678848:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879016:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788985542.879022:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973678976:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879044:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.879080:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875885973679104:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879100:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.879126:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973679104 00000100:00100000:3.0:1788985542.879129:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973679104 00000100:00100000:3.0:1788985542.879160:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769 00000100:00100000:3.0:1788985542.879165:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875885973679104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879198:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875885973679104:12345-0@lo:400:kworker.0 Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.879203:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769 00000100:00080000:3.0:1788985542.879218:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788985542.879236:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875885973679104:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879266:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875885973679232:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879289:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.879313:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973679232 00000100:00100000:3.0:1788985542.879316:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973679232 00000100:00100000:3.0:1788985542.879342:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770 00000100:00100000:3.0:1788985542.879347:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875885973679232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879377:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875885973679232:12345-0@lo:400:kworker.0 Request processed in 29us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.879382:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770 00000100:00080000:3.0:1788985542.879409:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788985542.879429:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b11422e4a80 x1875885973679232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788985542.879451:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875885973679232:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879484:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973679360:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879510:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.879537:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973679360 00000100:00100000:3.0:1788985542.879541:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973679360 00000100:00100000:3.0:1788985542.879568:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1788985542.879574:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973679360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879606:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973679360:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.879612:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00080000:3.0:1788985542.879630:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788985542.879648:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973679360:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879677:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788985542.879683:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973679488:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879706:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.879733:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973679488 00000100:00100000:3.0:1788985542.879736:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973679488 00000100:00100000:3.0:1788985542.879760:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1788985542.879765:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973679488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879793:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973679488:12345-0@lo:400:kworker.0 Request processed in 28us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.879798:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00080000:3.0:1788985542.879813:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788985542.879828:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973679488:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879855:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875885973679616:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.879886:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.879912:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973679616 00000100:00100000:3.0:1788985542.879916:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973679616 00000100:00100000:3.0:1788985542.879972:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1771 00000100:00100000:3.0:1788985542.879979:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875885973679616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.880011:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875885973679616:12345-0@lo:400:kworker.0 Request processed in 33us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.880017:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1771 00000100:00080000:3.0:1788985542.880031:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788985542.880049:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875885973679616:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.880080:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875885973679744:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.880105:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.880129:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973679744 00000100:00100000:3.0:1788985542.880132:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973679744 00000100:00100000:3.0:1788985542.880156:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1772 00000100:00100000:3.0:1788985542.880162:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875885973679744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.880195:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875885973679744:12345-0@lo:400:kworker.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.880201:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1772 00000100:00080000:3.0:1788985542.880213:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788985542.880232:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b11422e4a80 x1875885973679744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788985542.880241:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875885973679744:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.880272:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973679872:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.880296:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.880327:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973679872 00000100:00100000:3.0:1788985542.880331:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973679872 00000100:00100000:3.0:1788985542.880353:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1788985542.880358:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114391b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973679872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.880403:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114391b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973679872:12345-0@lo:400:kworker.0 Request processed in 44us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.880409:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00080000:3.0:1788985542.880425:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788985542.880441:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973679872:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.880472:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788985542.880477:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973680000:0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.880500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.880521:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973680000 00000100:00100000:3.0:1788985542.880524:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973680000 00000100:00100000:3.0:1788985542.880545:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1788985542.880551:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973680000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985542.880582:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973680000:12345-0@lo:400:kworker.0 Request processed in 31us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.880588:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00080000:3.0:1788985542.880603:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788985542.880618:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973680000:0@lo:400:kworker.0 00000100:00100000:2.0:1788985542.885428:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973678976 00000100:00100000:2.0:1788985542.885443:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973678976 00000100:00100000:2.0:1788985542.885505:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:2.0:1788985542.885514:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11422e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973678976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985542.885615:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11422e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973678976:12345-0@lo:400:kworker.0 Request processed in 102us (6569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985542.885622:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:2.0:1788985542.885668:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973678976:0@lo:400:kworker.0 00000100:00100000:2.0:1788985542.889279:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788985542.889302:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973680128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788985542.889369:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985542.891677:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788985542.891699:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973680256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788985542.891758:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985542.891804:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973680128 00000100:00100000:2.0:1788985542.891812:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973680128 00000100:00100000:2.0:1788985542.891862:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973680256 00000100:00100000:2.0:1788985542.891866:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973680256 00000100:00100000:2.0:1788985542.891881:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1788985542.891889:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973680128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788985542.891920:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788985542.891993:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973680128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (2624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985542.892000:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1788985542.892017:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1788985542.892023:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973680256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788985542.892033:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788985542.892060:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973680256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985542.892066:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1788985542.892339:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973680128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788985542.892374:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973680256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788985542.893891:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788985542.893911:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973680384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788985542.893979:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985542.894013:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973680384 00000100:00100000:3.0:1788985542.894018:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973680384 00000100:00100000:3.0:1788985542.894054:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:3.0:1788985542.894075:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973680384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788985542.894105:0:6519:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788985542.894144:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973680384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985542.894150:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:3.0:1788985542.894188:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973680384:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1788985543.146376:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788985543.146394:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b1262230000 from 1 10000000:01000000:0.0:1788985543.146400:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788985543.146452:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985543.146484:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985543.146498:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985543.146526:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973680512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788985543.147676:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985543.148094:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b11410b1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788985543.148356:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973680512 00000100:00100000:3.0:1788985543.148370:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973680512 00000100:00100000:3.0:1788985543.148434:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:3.0:1788985543.148444:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1267769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+23:6511:x1875885973680512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788985543.148458:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788985543.148475:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b12463c6200/0xa0dd3253da5304ca lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0dd3253da5304c3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985543.148499:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12463c6200/0xa0dd3253da5304ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0dd3253da5304c3 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985543.148510:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b12463c6200/0xa0dd3253da5304ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da5304c3 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985543.148519:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b12463c6200, rc 0) 00000100:00100000:3.0:1788985543.148582:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1267769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+24:6511:x1875885973680512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985543.148588:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1788985543.149196:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973680512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985543.149214:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5304ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985543.149225:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0dd3253da5304ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985543.149257:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788985543.149262:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5304ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985543.149271:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5304ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985543.710294:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985544.734200:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985545.762463:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985545.950392:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973680768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788985545.950413:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973680640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788985545.950477:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985545.950572:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985545.950644:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973680768 00000100:00100000:3.0:1788985545.950654:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973680768 00000100:00100000:3.0:1788985545.950719:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973680640 00000100:00100000:3.0:1788985545.950722:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973680640 00000100:00100000:3.0:1788985545.950757:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:3.0:1788985545.950766:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114407f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973680768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788985545.950796:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788985545.950842:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114407f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973680768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985545.950849:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:3.0:1788985545.950866:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:3.0:1788985545.950873:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973680640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788985545.950882:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788985545.950907:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973680640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985545.950913:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:1.0:1788985545.951019:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973680768:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788985545.951090:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985545.951112:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973680640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788985546.462467:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973680896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788985546.462549:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985546.462662:0:13641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973680896 00000100:00100000:2.0:1788985546.462671:0:13641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973680896 00000100:00100000:2.0:1788985546.462721:0:13641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1788985546.462744:0:13641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114391b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973680896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788985546.462780:0:13641:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788985546.462826:0:13641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114391b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973680896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985546.462832:0:13641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:3.0:1788985546.462911:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973680896:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788985546.782238:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788985546.997124:0:56937:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 22: test nodemap mapped_trusted_admin fileops ========================================================== 16:25:45 (1788985545) 00010000:00010000:0.0:1788985547.821366:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985547.840899:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788985547.840955:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788985547.841041:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788985547.841084:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953231104 00000100:00100000:0.0:1788985547.841094:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953231104 00000100:00100000:1.0:1788985547.841101:0:10354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953231232 00000100:00100000:0.0:1788985547.841164:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1773 00000100:00100000:1.0:1788985547.841173:0:10354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953231232 00000100:00100000:0.0:1788985547.841177:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2389:x1875885953231104:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788985547.841215:0:10354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1774 00000100:00100000:1.0:1788985547.841225:0:10354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2388:x1875885953231232:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788985547.841286:0:10354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2388:x1875885953231232:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 63us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985547.841289:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2389:x1875885953231104:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 112us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985547.842242:0:10354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1774 00000100:00100000:3.0:1788985547.842829:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953230976 00000100:00100000:3.0:1788985547.842838:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953230976 00000100:00100000:3.0:1788985547.842900:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 904 00000100:00100000:3.0:1788985547.842910:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126776ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2388:x1875885953230976:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788985547.842984:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126776ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2388:x1875885953230976:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 75us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985547.842991:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 904 00000100:00080000:2.0:1788985547.843119:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788985547.843125:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985547.843438:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1773 00000100:00100000:0.0:1788985547.998387:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788985547.998421:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973681024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788985547.998491:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985547.998566:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973681024 00000100:00100000:0.0:1788985547.998573:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973681024 00000100:00100000:0.0:1788985547.998633:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1788985547.998643:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973681024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788985547.998673:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788985547.998718:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973681024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985547.998725:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00080000:0.0:1788985547.998745:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985547.998751:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973681152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985547.998784:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985547.998786:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973681024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788985547.998819:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973681152 00000100:00100000:1.0:1788985547.998831:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973681152 00000100:00100000:1.0:1788985547.998862:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1788985547.998868:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973681152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985547.998878:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788985547.998907:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973681152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985547.998913:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1788985547.998966:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973681152:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788985547.998981:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788985548.002320:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1250ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973681536:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.002405:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985548.002454:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875885973682048:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.002479:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985548.002510:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1247c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875885973682560:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.002533:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985548.002558:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788985548.002565:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114305ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875885973681408:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.002588:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985548.002606:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1250acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875885973681920:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.002626:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985548.002641:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1247c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875885973682432:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.002660:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985548.002681:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973681280:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.002684:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973682048 00000100:00100000:2.0:1788985548.002691:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973682048 00000100:00100000:1.0:1788985548.002712:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985548.002734:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1250acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973681792:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.002738:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973682560 00000100:00100000:2.0:1788985548.002741:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973682560 00000100:00100000:2.0:1788985548.002754:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973681408 00000100:00100000:2.0:1788985548.002756:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973681408 00000100:00100000:1.0:1788985548.002756:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985548.002771:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1247c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973682304:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.002776:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973681920 00000100:00100000:2.0:1788985548.002779:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973681920 00000100:00100000:2.0:1788985548.002791:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973682432 00000100:00100000:1.0:1788985548.002792:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985548.002793:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973682432 00000100:00100000:1.0:1788985548.002806:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788985548.002807:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1775 00000100:00100000:1.0:1788985548.002811:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1250aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875885973681664:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.002815:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875885973682048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985548.002830:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985548.002839:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973682176:0@lo:400:kworker.0 00000100:00100000:1.0:1788985548.002854:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985548.002863:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875885973682048:12345-0@lo:400:kworker.0 Request processed in 49us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985548.002865:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973682688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788985548.002870:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1775 00000100:00100000:1.0:1788985548.002881:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985548.002885:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973681664 00000100:00100000:2.0:1788985548.002888:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973681664 00000100:00100000:2.0:1788985548.002902:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:2.0:1788985548.002907:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1142195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875885973682560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.002958:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1142195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875885973682560:12345-0@lo:400:kworker.0 Request processed in 50us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985548.003043:0:10354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:1.0:1788985548.003051:0:10354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875885973681408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985548.003086:0:10354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875885973681408:12345-0@lo:400:kworker.0 Request processed in 36us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985548.003098:0:10354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00100000:1.0:1788985548.003113:0:10354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:1.0:1788985548.003118:0:10354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875885973681920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985548.003161:0:10354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875885973681920:12345-0@lo:400:kworker.0 Request processed in 43us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985548.003165:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973681536 00000100:00100000:1.0:1788985548.003167:0:10354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00100000:0.0:1788985548.003174:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973681536 00000100:00100000:1.0:1788985548.003178:0:10354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1779 00000100:00100000:1.0:1788985548.003182:0:10354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875885973682432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985548.003194:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973681792 00000100:00100000:0.0:1788985548.003196:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973681792 00000100:00100000:1.0:1788985548.003206:0:10354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875885973682432:12345-0@lo:400:kworker.0 Request processed in 24us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985548.003207:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973682688 00000100:00100000:0.0:1788985548.003209:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973682688 00000100:00100000:1.0:1788985548.003212:0:10354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1779 00000100:00100000:0.0:1788985548.003219:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1788985548.003222:0:10354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780 00000100:00100000:0.0:1788985548.003225:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875885973681536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985548.003226:0:10354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11419b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875885973681664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985548.003255:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875885973681536:12345-0@lo:400:kworker.0 Request processed in 30us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985548.003261:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:0.0:1788985548.003273:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:0.0:1788985548.003278:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11419b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973681792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.003312:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00000100:00100000:2.0:1788985548.003351:0:13641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1788985548.003358:0:13641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973682688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788985548.003382:0:13641:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788985548.003425:0:10354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11419b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875885973681664:12345-0@lo:400:kworker.0 Request processed in 196us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985548.003434:0:10354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780 00000100:00100000:1.0:1788985548.003457:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973681280 00000100:00100000:1.0:1788985548.003460:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973681280 00000100:00100000:1.0:1788985548.003798:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1788985548.003807:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126776b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18d53938-9833-4a4f-b2bc-80656579f00f+24:3640:x1875885973681280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985548.003842:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126776b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18d53938-9833-4a4f-b2bc-80656579f00f+24:3640:x1875885973681280:12345-0@lo:400:kworker.0 Request processed in 38us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985548.003849:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1788985548.003901:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1250aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875885973681664:0@lo:400:kworker.0 00000100:00100000:1.0:1788985548.003953:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973681280:0@lo:400:kworker.0 00000100:00100000:0.0:1788985548.005097:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11419b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973681792:12345-0@lo:400:kworker.0 Request processed in 1814us (2335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985548.005108:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:0.0:1788985548.005157:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1250acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973681792:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.009226:0:13641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973682688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5857us (6331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985548.009242:0:13641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00080000:2.0:1788985548.009294:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788985548.009300:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788985548.009361:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114305ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875885973681408:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.009378:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1250acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875885973681920:0@lo:400:kworker.0 00000100:00100000:2.0:1788985548.009389:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1247c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875885973682432:0@lo:400:kworker.0 00000100:00100000:0.0:1788985548.009528:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973682688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788985548.009957:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1250ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973681536:0@lo:400:kworker.0 00010000:00080000:2.0:1788985548.009974:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b1277eb4700 x1875885973682048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788985548.009984:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875885973682048:0@lo:400:kworker.0 00010000:00080000:2.0:1788985548.009996:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b1247c42a00 x1875885973682560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788985548.010004:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1247c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875885973682560:0@lo:400:kworker.0 00000100:00100000:3.0:1788985548.010073:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973682304 00000100:00100000:3.0:1788985548.010080:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973682304 00000100:00100000:3.0:1788985548.010131:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973682176 00000100:00100000:3.0:1788985548.010135:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973682176 00000100:00100000:3.0:1788985548.010164:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1788985548.010172:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11419b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973682304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985548.010239:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11419b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973682304:12345-0@lo:400:kworker.0 Request processed in 68us (7446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985548.010245:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1788985548.010273:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1788985548.010278:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973682176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985548.010304:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973682176:12345-0@lo:400:kworker.0 Request processed in 27us (7449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985548.010309:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00080000:3.0:1788985548.010518:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788985548.010542:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973682176:0@lo:400:kworker.0 00000100:00100000:3.0:1788985548.010553:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1247c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973682304:0@lo:400:kworker.0 00000004:00000400:3.0:1788985548.321544:0:56985:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:3.0:1788985548.340663:0:56985:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000004:00000400:3.0:1788985548.341419:0:56985:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0001: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:3.0:1788985548.341422:0:56985:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to NONE 00010000:00010000:1.0:1788985548.834453:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788985549.282641:0:57033:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdfc2c6c10 20000000:00000080:1.0:1788985549.282659:0:57033:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b126eb68800 uarg=0000000000000000 10000000:01000000:1.0:1788985549.283183:0:57033:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985549.283203:0:57033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985549.283221:0:57033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b12463c6200/0xa0dd3253da5304ca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da5304c3 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985549.283230:0:57033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985549.283272:0:57033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b12463c6200/0xa0dd3253da5304ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0dd3253da5304c3 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985549.283287:0:57033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b12463c6200/0xa0dd3253da5304ca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0dd3253da5304c3 expref: 23 pid: 6506 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985549.283303:0:57033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57033:1875885973682816:0@lo:104: 00000100:00100000:1.0:1788985549.283379:0:57033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985549.283471:0:57033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b114302a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788985549.283519:0:26567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973682816 00000100:00100000:2.0:1788985549.283527:0:26567:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973682816 00000100:00100000:2.0:1788985549.283610:0:26567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788985549.283621:0:26567:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:18d53938-9833-4a4f-b2bc-80656579f00f+3:57033:x1875885973682816:12345-0@lo:104: 00010000:00010000:2.0:1788985549.283634:0:26567:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da5304ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985549.283705:0:26567:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788985549.283712:0:26567:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:18d53938-9833-4a4f-b2bc-80656579f00f+3:57033:x1875885973682816:12345-0@lo:104: Request processed in 94us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985549.283719:0:26567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788985549.283785:0:57033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57033:1875885973682816:0@lo:104: 00010000:00010000:3.0:1788985549.283804:0:57033:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.283869:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985549.283876:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da5304ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.283884:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12677e8e00 already unused, calling callback (ffffffffc13e9c20) 10000000:00010000:0.0:1788985549.283888:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0dd3253da5304ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.283895:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0dd3253da5304ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788985549.283919:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0dd3253da5304ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985549.283958:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788985549.283992:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da5304ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284000:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788985549.284026:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da5304ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284032:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff8b12677e8e00/0xa0dd3253da5304c3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da5304ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284047:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985549.284048:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985549.284050:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985549.284061:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973682944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985549.284095:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985549.284137:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973682944 00000100:00100000:0.0:1788985549.284142:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973682944 00010000:00010000:0.0:1788985549.284161:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b12463c6200/0xa0dd3253da5304ca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da5304c3 expref: 24 pid: 6506 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985549.284184:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788985549.284191:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18d53938-9833-4a4f-b2bc-80656579f00f+24:3640:x1875885973682944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985549.284201:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985549.284205:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b12463c6200/0xa0dd3253da5304ca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da5304c3 expref: 24 pid: 6506 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284222:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b12463c6200/0xa0dd3253da5304ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0dd3253da5304c3 expref: 24 pid: 6506 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284234:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12463c6200/0xa0dd3253da5304ca lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0dd3253da5304c3 expref: 24 pid: 6506 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284248:0:10333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284256:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284270:0:10333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284277:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284284:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284290:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284297:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12617eb800 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:0.0:1788985549.284301:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284308:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284342:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.284352:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788985549.284381:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18d53938-9833-4a4f-b2bc-80656579f00f+23:3640:x1875885973682944:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985549.284388:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788985549.284416:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973682944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788985549.284488:0:57033:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985549.284498:0:57033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985549.284514:0:57033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12617eb800/0xa0dd3253da5304d1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985549.854148:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788985550.244566:0:57081:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcdc6873d0 20000000:00000080:3.0:1788985550.244582:0:57081:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b126eadec00 uarg=0000000000000000 10000000:01000000:3.0:1788985550.244803:0:57081:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788985550.244824:0:57081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12463c7400/0xa0dd3253da5304d8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985550.244841:0:57081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12463c7400/0xa0dd3253da5304d8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985550.244851:0:57081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c7400/0xa0dd3253da5304d8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985550.244857:0:57081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c7400/0xa0dd3253da5304d8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985550.244865:0:57081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12463c7400/0xa0dd3253da5304d8 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985550.244872:0:57081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12463c7400/0xa0dd3253da5304d8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985550.244878:0:57081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12463c7400 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:3.0:1788985550.244882:0:57081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12463c7400/0xa0dd3253da5304d8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985550.244889:0:57081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12463c7400/0xa0dd3253da5304d8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985550.244914:0:57081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12463c7400/0xa0dd3253da5304d8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985550.244922:0:57081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12463c7400/0xa0dd3253da5304d8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985550.245033:0:57081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12463c7400/0xa0dd3253da5304d8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985550.307866:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788985550.307874:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b1262230000 from 1 10000000:01000000:1.0:1788985550.307879:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788985550.308055:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985550.308068:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985550.308090:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985550.308116:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973683072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788985550.308183:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985550.308228:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b114302a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788985550.309242:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973683072 00000100:00100000:0.0:1788985550.309252:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973683072 00000100:00100000:0.0:1788985550.309334:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:0.0:1788985550.309346:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126776b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+23:6511:x1875885973683072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985550.309373:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985550.309391:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304e6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0dd3253da5304df expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985550.309416:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0dd3253da5304df expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985550.309426:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da5304df expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985550.309435:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b12677e8e00, rc 0) 00000100:00100000:0.0:1788985550.309500:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126776b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+24:6511:x1875885973683072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985550.309506:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:1.0:1788985550.309968:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973683072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985550.309991:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5304e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985550.310011:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0dd3253da5304e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985550.310034:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788985550.310040:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5304e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985550.310048:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5304e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985550.885691:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985551.071541:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973683200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788985551.071628:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985551.071710:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973683200 00000100:00100000:0.0:1788985551.071718:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973683200 00000100:00100000:0.0:1788985551.071776:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1788985551.071786:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973683200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788985551.071814:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788985551.071858:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973683200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985551.071865:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00080000:0.0:1788985551.071884:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985551.071917:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973683200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788985551.072945:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973683328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985551.072985:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985551.073046:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973683328 00000100:00100000:0.0:1788985551.073051:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973683328 00000100:00100000:0.0:1788985551.073089:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:0.0:1788985551.073097:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973683328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788985551.073111:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788985551.073147:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973683328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985551.073154:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00080000:0.0:1788985551.073170:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985551.073193:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973683328:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788985551.364676:0:57129:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffccd64ab30 20000000:00000080:3.0:1788985551.364697:0:57129:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b126eaddc00 uarg=0000000000000000 10000000:01000000:3.0:1788985551.364862:0:57129:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788985551.364883:0:57129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985551.364902:0:57129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304e6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da5304df expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985551.364910:0:57129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985551.365423:0:57129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0dd3253da5304df expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985551.365439:0:57129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304e6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0dd3253da5304df expref: 23 pid: 6506 timeout: 1491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985551.365454:0:57129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57129:1875885973683456:0@lo:104: 00000100:00100000:3.0:1788985551.365654:0:57129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985551.365773:0:57129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b1144018540 going to sleep for 11 seconds 00000100:00100000:0.0:1788985551.365825:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973683456 00000100:00100000:0.0:1788985551.365833:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973683456 00000100:00100000:0.0:1788985551.365889:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788985551.365900:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:18d53938-9833-4a4f-b2bc-80656579f00f+3:57129:x1875885973683456:12345-0@lo:104: 00010000:00010000:0.0:1788985551.365914:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da5304e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985551.366492:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788985551.366501:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:18d53938-9833-4a4f-b2bc-80656579f00f+3:57129:x1875885973683456:12345-0@lo:104: Request processed in 602us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985551.366509:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00010000:00010000:0.0:1788985551.366572:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985551.366588:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da5304e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.366597:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12617eb600 already unused, calling callback (ffffffffc13e9c20) 10000000:00010000:0.0:1788985551.366602:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0dd3253da5304e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.366611:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0dd3253da5304e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788985551.366618:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0dd3253da5304e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985551.366624:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788985551.366661:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da5304e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.366669:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788985551.366702:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da5304e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.366710:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff8b12617eb600/0xa0dd3253da5304df lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da5304e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.366730:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985551.366739:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985551.366741:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985551.366749:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788985551.366761:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973683584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985551.366803:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985551.366841:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973683584 00000100:00100000:0.0:1788985551.366846:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973683584 00010000:00010000:0.0:1788985551.366866:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304e6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da5304df expref: 24 pid: 6506 timeout: 1491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985551.366887:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788985551.366894:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126ce50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18d53938-9833-4a4f-b2bc-80656579f00f+24:3640:x1875885973683584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985551.366905:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985551.366910:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304e6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da5304df expref: 24 pid: 6506 timeout: 1491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.366922:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304e6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0dd3253da5304df expref: 24 pid: 6506 timeout: 1491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.366963:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.366972:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.367070:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.367079:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.367097:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.367104:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.367110:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12463c7600 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:0.0:1788985551.367115:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.367123:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.367133:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985551.367143:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788985551.367173:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126ce50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18d53938-9833-4a4f-b2bc-80656579f00f+24:3640:x1875885973683584:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985551.367180:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788985551.367245:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973683584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788985551.367795:0:57129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12677e8e00/0xa0dd3253da5304e6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0dd3253da5304df expref: 23 pid: 6506 timeout: 1491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985551.367807:0:57129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57129:1875885973683456:0@lo:104: 00010000:00010000:3.0:1788985551.367824:0:57129:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985551.367834:0:57129:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985551.367841:0:57129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985551.367848:0:57129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304ed lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985551.582379:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788985551.582404:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973683712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788985551.583105:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985551.583341:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973683712 00000100:00100000:2.0:1788985551.583350:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973683712 00000100:00100000:2.0:1788985551.583408:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:2.0:1788985551.583418:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973683712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788985551.583457:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788985551.583687:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973683712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 270us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985551.583706:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:1.0:1788985551.584118:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973683712:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788985551.907789:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788985552.602232:0:57177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4827d640 20000000:00000080:3.0:1788985552.602250:0:57177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b126eadf400 uarg=0000000000000000 10000000:01000000:3.0:1788985552.602429:0:57177:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788985552.602453:0:57177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304f4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.602470:0:57177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304f4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.602481:0:57177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304f4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.602487:0:57177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304f4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.602505:0:57177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304f4 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.602513:0:57177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304f4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.602520:0:57177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12463c7600 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:3.0:1788985552.602524:0:57177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304f4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.602532:0:57177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304f4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.602545:0:57177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304f4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.602553:0:57177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304f4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.602559:0:57177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12463c7600/0xa0dd3253da5304f4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788985552.880312:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788985552.880321:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b1262230000 from 1 10000000:01000000:3.0:1788985552.880326:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788985552.880375:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.880387:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.880411:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985552.880436:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973683840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788985552.880508:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985552.880576:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b127c164e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788985552.880695:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973683840 00000100:00100000:2.0:1788985552.880704:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973683840 00000100:00100000:2.0:1788985552.880760:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:2.0:1788985552.880771:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1267769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18d53938-9833-4a4f-b2bc-80656579f00f+23:6511:x1875885973683840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985552.880784:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985552.880797:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b11433eb800/0xa0dd3253da530502 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0dd3253da5304fb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985552.880820:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b11433eb800/0xa0dd3253da530502 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0dd3253da5304fb expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985552.880830:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b11433eb800/0xa0dd3253da530502 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da5304fb expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985552.880838:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b11433eb800, rc 0) 00000100:00100000:2.0:1788985552.880882:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1267769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18d53938-9833-4a4f-b2bc-80656579f00f+24:6511:x1875885973683840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985552.880889:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:3.0:1788985552.884221:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973683840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788985552.884250:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da530502 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.884261:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0dd3253da530502 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788985552.884286:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788985552.884301:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da530502 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.884309:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da530502 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985552.927315:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985552.954443:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788985552.954479:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788985552.954503:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788985552.954532:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953231360 00000100:00100000:2.0:1788985552.954542:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953231360 00000100:00100000:2.0:1788985552.954588:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 908 00000100:00100000:2.0:1788985552.954598:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1267769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2389:x1875885953231360:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788985552.954667:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1267769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2389:x1875885953231360:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 70us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985552.954681:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 908 00000100:00100000:2.0:1788985552.954716:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953231616 00000100:00100000:2.0:1788985552.954720:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953231616 00000100:00100000:2.0:1788985552.954757:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953231488 00000100:00100000:2.0:1788985552.954760:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953231488 00000100:00100000:2.0:1788985552.954783:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1781 00000100:00100000:2.0:1788985552.954789:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2389:x1875885953231616:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788985552.954823:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2389:x1875885953231616:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 34us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985552.954829:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1781 00000100:00100000:2.0:1788985552.954841:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1782 00000100:00100000:2.0:1788985552.954847:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2389:x1875885953231488:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788985552.954870:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2389:x1875885953231488:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985552.954877:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1782 00000100:00080000:2.0:1788985552.955010:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788985552.955014:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788985553.120516:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788985553.120539:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973683968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788985553.120833:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.120893:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973683968 00000100:00100000:3.0:1788985553.120902:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973683968 00000100:00100000:3.0:1788985553.120981:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:3.0:1788985553.121002:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973683968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788985553.121031:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788985553.121074:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973683968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985553.121080:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00080000:3.0:1788985553.121100:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788985553.121135:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973683968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788985553.121440:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973684224:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.121716:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.121737:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875885973684736:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.121761:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.121777:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875885973685248:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.121795:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.121822:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788985553.121828:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875885973684352:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.121847:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.121869:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973684864:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.121890:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.121904:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973685376:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.121922:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.121988:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973684224 00000100:00100000:3.0:1788985553.121993:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973684224 00000100:00100000:3.0:1788985553.122027:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1788985553.122034:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973684224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.122073:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973684224:12345-0@lo:400:kworker.0 Request processed in 39us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985553.122087:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1788985553.122107:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973684736 00000100:00100000:3.0:1788985553.122110:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973684736 00000100:00100000:3.0:1788985553.122136:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973685248 00000100:00100000:3.0:1788985553.122139:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973685248 00000100:00100000:3.0:1788985553.122155:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973684352 00000100:00100000:3.0:1788985553.122157:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973684352 00000100:00100000:3.0:1788985553.122170:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1783 00000100:00100000:3.0:1788985553.122175:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875885973684736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.122993:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875885973684736:12345-0@lo:400:kworker.0 Request processed in 814us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985553.123001:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1783 00000100:00100000:3.0:1788985553.123020:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:3.0:1788985553.123030:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875885973685248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.123063:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875885973685248:12345-0@lo:400:kworker.0 Request processed in 36us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985553.123069:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00100000:3.0:1788985553.123080:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:3.0:1788985553.123085:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875885973684352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.123108:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875885973684352:12345-0@lo:400:kworker.0 Request processed in 23us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985553.123113:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00100000:3.0:1788985553.123132:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973684864 00000100:00100000:3.0:1788985553.123136:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973684864 00000100:00100000:3.0:1788985553.123163:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973685376 00000100:00100000:3.0:1788985553.123166:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973685376 00000100:00100000:3.0:1788985553.123184:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1788985553.123199:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973684864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.123243:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973684864:12345-0@lo:400:kworker.0 Request processed in 45us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985553.123249:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1788985553.123260:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1788985553.123266:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973685376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.123300:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973685376:12345-0@lo:400:kworker.0 Request processed in 35us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985553.123305:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00080000:3.0:1788985553.123331:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788985553.123335:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788985553.123337:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788985553.123350:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875885973684096:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.123380:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.123402:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875885973684608:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.123424:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.123436:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875885973685120:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.123469:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.123483:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788985553.123489:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973684480:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.123510:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.123529:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973684992:0@lo:400:kworker.0 00000100:00100000:1.0:1788985553.123720:0:13641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973684480 00000100:00100000:1.0:1788985553.123725:0:13641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973684480 00000100:00100000:1.0:1788985553.123751:0:13641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:1.0:1788985553.123758:0:13641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973684480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985553.124164:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973685504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788985553.124302:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973684096 00000100:00100000:2.0:1788985553.124306:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973684096 00000100:00100000:2.0:1788985553.124327:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973684608 00000100:00100000:2.0:1788985553.124329:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973684608 00000100:00100000:2.0:1788985553.124349:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973685120 00000100:00100000:2.0:1788985553.124352:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973685120 00000100:00100000:2.0:1788985553.124365:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786 00000100:00100000:2.0:1788985553.124371:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875885973684096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985553.124456:0:13641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973684480:12345-0@lo:400:kworker.0 Request processed in 698us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985553.124463:0:13641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:1.0:1788985553.124957:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787 00000100:00100000:1.0:1788985553.124966:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875885973684608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985553.125014:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875885973684608:12345-0@lo:400:kworker.0 Request processed in 50us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985553.125020:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787 00000100:00100000:1.0:1788985553.125034:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788 00000100:00100000:1.0:1788985553.125041:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875885973685120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985553.125064:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875885973685120:12345-0@lo:400:kworker.0 Request processed in 24us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985553.125070:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788 00000100:00080000:1.0:1788985553.125091:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985553.125134:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875885973684352:0@lo:400:kworker.0 00000100:00100000:1.0:1788985553.125147:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973684864:0@lo:400:kworker.0 00000100:00100000:1.0:1788985553.125157:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973685376:0@lo:400:kworker.0 00000100:00100000:1.0:1788985553.125182:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973684224:0@lo:400:kworker.0 00010000:00080000:1.0:1788985553.125196:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b1143919c00 x1875885973684736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788985553.125219:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875885973684736:0@lo:400:kworker.0 00010000:00080000:1.0:1788985553.125230:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b11422e4e00 x1875885973685248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788985553.125239:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b11422e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875885973685248:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.128836:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.128921:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875885973684608:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.128950:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875885973685120:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.129001:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973685632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788985553.129047:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985553.129079:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973684480:0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.129110:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973684992 00000100:00100000:3.0:1788985553.129116:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973684992 00000100:00100000:3.0:1788985553.129168:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1788985553.129176:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973684992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985553.129240:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973684992:12345-0@lo:400:kworker.0 Request processed in 63us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985553.129247:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00080000:3.0:1788985553.129268:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788985553.129304:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973684992:0@lo:400:kworker.0 00000100:00100000:0.0:1788985553.132787:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973685632 00000100:00100000:0.0:1788985553.132801:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973685632 00000100:00100000:0.0:1788985553.132860:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1788985553.132870:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973685632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788985553.132892:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788985553.135140:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973685632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2264us (6084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985553.135154:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1788985553.135350:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973685632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788985553.135419:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985553.135537:0:13641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973685504 00000100:00100000:0.0:1788985553.135543:0:13641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973685504 00000100:00100000:0.0:1788985553.136364:0:13641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1788985553.136377:0:13641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973685504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788985553.136413:0:13641:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788985553.136888:0:13641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973685504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 515us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985553.136896:0:13641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1788985553.136963:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973685504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788985553.139727:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875885973684096:12345-0@lo:400:kworker.0 Request processed in 15348us (16338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985553.139754:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786 00000100:00100000:0.0:1788985553.139896:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114391ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875885973684096:0@lo:400:kworker.0 00000020:00000080:1.0:1788985553.722779:0:57226:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd20e999e0 20000000:00000080:1.0:1788985553.722800:0:57226:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b1275651800 uarg=0000000000000000 10000000:01000000:1.0:1788985553.723205:0:57226:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985553.723225:0:57226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985553.723244:0:57226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b11433eb800/0xa0dd3253da530502 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da5304fb expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985553.723252:0:57226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985553.723309:0:57226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b11433eb800/0xa0dd3253da530502 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0dd3253da5304fb expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985553.723322:0:57226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b11433eb800/0xa0dd3253da530502 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0dd3253da5304fb expref: 23 pid: 6509 timeout: 1493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985553.723650:0:57226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57226:1875885973685760:0@lo:104: 00000100:00100000:1.0:1788985553.723716:0:57226:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985553.723827:0:57226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b114192f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788985553.723872:0:26567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973685760 00000100:00100000:2.0:1788985553.723879:0:26567:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973685760 00000100:00100000:2.0:1788985553.724218:0:26567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788985553.724229:0:26567:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:18d53938-9833-4a4f-b2bc-80656579f00f+3:57226:x1875885973685760:12345-0@lo:104: 00010000:00010000:2.0:1788985553.724242:0:26567:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da530502 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724322:0:26567:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788985553.724327:0:26567:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:18d53938-9833-4a4f-b2bc-80656579f00f+3:57226:x1875885973685760:12345-0@lo:104: Request processed in 102us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985553.724345:0:26567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00010000:2.0:1788985553.724367:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985553.724373:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da530502 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724380:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12463c7600 already unused, calling callback (ffffffffc13e9c20) 10000000:00010000:2.0:1788985553.724385:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0dd3253da530502 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724394:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0dd3253da530502 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985553.724402:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0dd3253da530502 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985553.724409:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985553.724438:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da530502 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724464:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985553.724486:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da530502 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724493:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff8b12463c7600/0xa0dd3253da5304fb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da530502 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724508:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985553.724510:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985553.724512:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985553.724533:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:18d53938-9833-4a4f-b2bc-80656579f00f:3639:1875885973685888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985553.724563:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985553.724606:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973685888 00000100:00100000:2.0:1788985553.724610:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973685888 00010000:00010000:2.0:1788985553.724629:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b11433eb800/0xa0dd3253da530502 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da5304fb expref: 24 pid: 6509 timeout: 1493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985553.724652:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788985553.724659:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18d53938-9833-4a4f-b2bc-80656579f00f+24:3639:x1875885973685888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985553.724670:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985553.724675:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b11433eb800/0xa0dd3253da530502 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da5304fb expref: 24 pid: 6509 timeout: 1493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724684:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b11433eb800/0xa0dd3253da530502 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0dd3253da5304fb expref: 24 pid: 6509 timeout: 1493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724700:0:10333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724718:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724733:0:10333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724740:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724747:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724753:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724759:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12617ea000 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:2.0:1788985553.724763:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724771:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724779:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.724788:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985553.724818:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18d53938-9833-4a4f-b2bc-80656579f00f+24:3639:x1875885973685888:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985553.724824:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788985553.724859:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:18d53938-9833-4a4f-b2bc-80656579f00f:3639:1875885973685888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985553.724960:0:57226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b11433eb800/0xa0dd3253da530502 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0dd3253da5304fb expref: 23 pid: 6509 timeout: 1493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985553.724980:0:57226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57226:1875885973685760:0@lo:104: 00010000:00010000:1.0:1788985553.724993:0:57226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985553.725001:0:57226:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985553.725017:0:57226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985553.725024:0:57226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12617ea000/0xa0dd3253da530509 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985553.960173:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788985554.630824:0:57274:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc349c7e0 20000000:00000080:3.0:1788985554.630837:0:57274:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b1143019800 uarg=0000000000000000 10000000:01000000:3.0:1788985554.631172:0:57274:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788985554.631191:0:57274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530510 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985554.631208:0:57274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530510 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985554.631219:0:57274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530510 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985554.631226:0:57274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530510 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985554.631234:0:57274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530510 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985554.631249:0:57274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530510 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985554.631255:0:57274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12463c7a00 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:3.0:1788985554.631259:0:57274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530510 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985554.631268:0:57274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530510 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985554.631290:0:57274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530510 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985554.631300:0:57274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530510 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985554.631306:0:57274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530510 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985554.976592:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788985555.432013:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788985555.432021:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b1262230000 from 1 10000000:01000000:2.0:1788985555.432026:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788985555.432077:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985555.432088:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985555.432100:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985555.432127:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973686016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788985555.432202:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985555.432294:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b114301c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788985555.432296:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973686016 00000100:00100000:0.0:1788985555.432313:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973686016 00000100:00100000:0.0:1788985555.432400:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1788985555.432412:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126776a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+23:6511:x1875885973686016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985555.432443:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985555.432486:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b12677e8000/0xa0dd3253da53051e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0dd3253da530517 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985555.432524:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12677e8000/0xa0dd3253da53051e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0dd3253da530517 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985555.432540:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b12677e8000/0xa0dd3253da53051e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da530517 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985555.432569:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b12677e8000, rc 0) 00000100:00100000:0.0:1788985555.432662:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126776a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+24:6511:x1875885973686016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 252us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985555.432670:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:2.0:1788985555.433715:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973686016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985555.433742:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da53051e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985555.433753:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0dd3253da53051e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985555.433780:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788985555.433786:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da53051e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985555.433794:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da53051e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985556.000837:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985556.193152:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788985556.193186:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973686144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788985556.193289:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985556.193400:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973686144 00000100:00100000:1.0:1788985556.193412:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973686144 00000100:00100000:1.0:1788985556.193477:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1788985556.193491:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973686144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788985556.193528:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788985556.193581:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973686144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985556.193589:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1788985556.193637:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973686144:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788985556.193789:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985556.193915:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788985556.193957:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1247c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973686272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985556.193989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985556.194233:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973686272 00000100:00100000:3.0:1788985556.194239:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973686272 00000100:00100000:3.0:1788985556.194296:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:3.0:1788985556.194303:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973686272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788985556.194315:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788985556.194361:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973686272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985556.194367:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1788985556.194452:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1247c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973686272:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788985556.194544:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788985556.702213:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973686400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788985556.702300:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985556.702610:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973686400 00000100:00100000:1.0:1788985556.702621:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973686400 00000100:00100000:1.0:1788985556.702680:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1788985556.702691:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12430bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973686400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788985556.702732:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788985556.702795:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12430bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973686400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985556.702803:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1788985556.703156:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973686400:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788985557.023079:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788985557.894727:0:57421:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff043119f0 20000000:00000080:3.0:1788985557.894751:0:57421:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b114301b800 uarg=0000000000000000 10000000:01000000:3.0:1788985557.894967:0:57421:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788985557.894990:0:57421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985557.895008:0:57421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b12677e8000/0xa0dd3253da53051e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da530517 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985557.895017:0:57421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985557.895059:0:57421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b12677e8000/0xa0dd3253da53051e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0dd3253da530517 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985557.895073:0:57421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b12677e8000/0xa0dd3253da53051e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0dd3253da530517 expref: 23 pid: 6506 timeout: 1497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985557.895088:0:57421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1247c53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57421:1875885973686528:0@lo:104: 00000100:00100000:3.0:1788985557.895156:0:57421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985557.895211:0:57421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b12540ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1788985557.895445:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973686528 00000100:00100000:2.0:1788985557.895454:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973686528 00000100:00100000:2.0:1788985557.895513:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788985557.895523:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:18d53938-9833-4a4f-b2bc-80656579f00f+3:57421:x1875885973686528:12345-0@lo:104: 00010000:00010000:2.0:1788985557.895538:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da53051e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.895596:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788985557.895602:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:18d53938-9833-4a4f-b2bc-80656579f00f+3:57421:x1875885973686528:12345-0@lo:104: Request processed in 81us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985557.895608:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00010000:00010000:2.0:1788985557.895630:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985557.895636:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da53051e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.895643:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b11433eb000 already unused, calling callback (ffffffffc13e9c20) 10000000:00010000:2.0:1788985557.895648:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0dd3253da53051e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.895656:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0dd3253da53051e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985557.895664:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0dd3253da53051e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985557.895678:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985557.895709:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da53051e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.895715:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985557.895737:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da53051e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.895744:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff8b11433eb000/0xa0dd3253da530517 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da53051e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.895761:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985557.895763:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985557.895764:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985557.895788:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:18d53938-9833-4a4f-b2bc-80656579f00f:3639:1875885973686656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985557.895819:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985557.895865:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973686656 00000100:00100000:2.0:1788985557.895869:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973686656 00010000:00010000:2.0:1788985557.895887:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b12677e8000/0xa0dd3253da53051e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da530517 expref: 24 pid: 6506 timeout: 1497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985557.895908:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788985557.895915:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18d53938-9833-4a4f-b2bc-80656579f00f+24:3639:x1875885973686656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985557.895947:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985557.895954:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b12677e8000/0xa0dd3253da53051e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da530517 expref: 24 pid: 6506 timeout: 1497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.895964:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b12677e8000/0xa0dd3253da53051e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0dd3253da530517 expref: 24 pid: 6506 timeout: 1497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.895985:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.895993:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.896005:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.896013:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.896019:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.896025:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.896031:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12463c7a00 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:2.0:1788985557.896035:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.896042:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.896052:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985557.896061:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985557.896090:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18d53938-9833-4a4f-b2bc-80656579f00f+24:3639:x1875885973686656:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985557.896106:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788985557.896147:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:18d53938-9833-4a4f-b2bc-80656579f00f:3639:1875885973686656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985557.896291:0:57421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12677e8000/0xa0dd3253da53051e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0dd3253da530517 expref: 23 pid: 6506 timeout: 1497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985557.896304:0:57421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1247c53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57421:1875885973686528:0@lo:104: 00010000:00010000:0.0:1788985557.896322:0:57421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985557.896331:0:57421:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985557.896337:0:57421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985557.896344:0:57421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12463c7a00/0xa0dd3253da530525 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985558.059699:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985558.085753:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788985558.085793:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788985558.085825:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788985558.086529:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953231872 00000100:00100000:1.0:1788985558.086541:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953231872 00000100:00100000:1.0:1788985558.086601:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953232000 00000100:00100000:1.0:1788985558.086605:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953232000 00000100:00100000:1.0:1788985558.086633:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1789 00000100:00100000:1.0:1788985558.086643:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2391:x1875885953231872:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788985558.086719:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2391:x1875885953231872:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 78us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985558.086726:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1789 00000100:00100000:1.0:1788985558.086743:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1790 00000100:00100000:1.0:1788985558.086749:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2391:x1875885953232000:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788985558.086773:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2391:x1875885953232000:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 25us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985558.086779:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1790 00000100:00080000:1.0:1788985558.086812:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788985558.086815:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985558.092407:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953231744 00000100:00100000:2.0:1788985558.092424:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953231744 00000100:00100000:2.0:1788985558.092491:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 910 00000100:00100000:2.0:1788985558.092503:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126776a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2391:x1875885953231744:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788985558.092581:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126776a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2391:x1875885953231744:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 81us (6787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985558.092589:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 910 00000100:00100000:1.0:1788985558.238448:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788985558.238491:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1247c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973686784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985558.238576:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985558.238838:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973686784 00000100:00100000:3.0:1788985558.238848:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973686784 00000100:00100000:3.0:1788985558.238947:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1788985558.238959:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973686784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788985558.238996:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788985558.239056:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973686784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985558.239064:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1788985558.239113:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1247c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973686784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985558.239710:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875885973687296:0@lo:400:kworker.0 00000100:00100000:0.0:1788985558.239741:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985558.239767:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973687808:0@lo:400:kworker.0 00000100:00100000:0.0:1788985558.239802:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985558.239819:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973688320:0@lo:400:kworker.0 00000100:00100000:0.0:1788985558.239839:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985558.239857:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788985558.239863:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973687168:0@lo:400:kworker.0 00000100:00100000:0.0:1788985558.239885:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985558.239901:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875885973687680:0@lo:400:kworker.0 00000100:00100000:0.0:1788985558.239915:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985558.239923:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875885973688192:0@lo:400:kworker.0 00000100:00100000:0.0:1788985558.239957:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985558.240000:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973687168 00000100:00100000:0.0:1788985558.240004:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973687168 00000100:00100000:0.0:1788985558.240029:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1788985558.240037:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973687168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985558.240080:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973687168:12345-0@lo:400:kworker.0 Request processed in 44us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985558.240087:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1788985558.240118:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973687168:0@lo:400:kworker.0 00000100:00080000:1.0:1788985558.240363:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985558.240379:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973687296 00000100:00100000:1.0:1788985558.240383:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973687296 00000100:00100000:1.0:1788985558.240417:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973687680 00000100:00100000:1.0:1788985558.240420:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973687680 00000100:00100000:1.0:1788985558.240444:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973688192 00000100:00100000:1.0:1788985558.240447:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973688192 00000100:00100000:1.0:1788985558.240461:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1791 00000100:00100000:1.0:1788985558.240467:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875885973687296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985558.240495:0:10354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792 00000100:00100000:2.0:1788985558.240505:0:10354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875885973687680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985558.240506:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875885973687296:12345-0@lo:400:kworker.0 Request processed in 40us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985558.240512:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1791 00000100:00100000:1.0:1788985558.240525:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:1.0:1788985558.240530:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875885973688192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985558.240536:0:10354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875885973687680:12345-0@lo:400:kworker.0 Request processed in 34us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985558.240542:0:10354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792 00000100:00100000:1.0:1788985558.240568:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875885973688192:12345-0@lo:400:kworker.0 Request processed in 38us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985558.240574:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00100000:3.0:1788985558.240584:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:18d53938-9833-4a4f-b2bc-80656579f00f:3641:1875885973686912:0@lo:400:kworker.0 00000100:00080000:1.0:1788985558.240598:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788985558.240617:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b12412a9f80 x1875885973687680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788985558.240619:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985558.240628:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875885973687680:0@lo:400:kworker.0 00010000:00080000:1.0:1788985558.240638:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b1277eb7100 x1875885973688192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788985558.240646:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875885973688192:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.240651:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973687424:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.240672:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985558.240678:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875885973687296:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.240689:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973687936:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.240708:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985558.240719:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973687808 00000100:00100000:3.0:1788985558.240722:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973688448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788985558.240722:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973687808 00000100:00100000:3.0:1788985558.240742:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985558.240750:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973688320 00000100:00100000:3.0:1788985558.240759:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788985558.240765:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875885973687040:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.240786:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985558.240802:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875885973687552:0@lo:400:kworker.0 00000100:00100000:1.0:1788985558.240821:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973688320 00000100:00100000:3.0:1788985558.240822:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985558.240838:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875885973688064:0@lo:400:kworker.0 00000100:00100000:1.0:1788985558.240846:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973687936 00000100:00100000:1.0:1788985558.240849:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973687936 00000100:00100000:3.0:1788985558.240858:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985558.240862:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1788985558.240867:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973687808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.240872:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973688576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788985558.240890:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985558.240899:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973687808:12345-0@lo:400:kworker.0 Request processed in 32us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985558.240905:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1788985558.240914:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1788985558.240920:0:8545:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973688320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985558.240961:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973686912 00000100:00100000:2.0:1788985558.240965:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973686912 00000100:00100000:2.0:1788985558.240990:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1788985558.240996:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1267768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+23:3641:x1875885973686912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985558.241030:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1267768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+23:3641:x1875885973686912:12345-0@lo:400:kworker.0 Request processed in 34us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985558.241036:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1788985558.241101:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1788985558.241109:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973687936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985558.241124:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973688448 00000100:00100000:2.0:1788985558.241127:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973688448 00000100:00100000:1.0:1788985558.241141:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973687936:12345-0@lo:400:kworker.0 Request processed in 34us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985558.241146:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1788985558.241148:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1788985558.241163:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973687040 00000100:00100000:1.0:1788985558.241166:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973687040 00000100:00100000:1.0:1788985558.241187:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973687552 00000100:00100000:1.0:1788985558.241190:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973687552 00000100:00100000:1.0:1788985558.241201:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973688064 00000100:00100000:1.0:1788985558.241204:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973688064 00000100:00100000:1.0:1788985558.241216:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794 00000100:00100000:1.0:1788985558.241221:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875885973687040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985558.241261:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875885973687040:12345-0@lo:400:kworker.0 Request processed in 39us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985558.241288:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794 00000100:00100000:2.0:1788985558.241292:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875885973688448:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788985558.241299:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1795 00000100:00100000:1.0:1788985558.241304:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875885973687552:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788985558.241305:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788985558.241331:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875885973688448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985558.241331:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875885973687552:12345-0@lo:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985558.241338:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1788985558.241338:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1795 00000100:00100000:1.0:1788985558.241349:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796 00000100:00100000:1.0:1788985558.241354:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875885973688064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985558.241361:0:13641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973687424 00000100:00100000:2.0:1788985558.241364:0:13641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973687424 00000100:00100000:1.0:1788985558.241378:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875885973688064:12345-0@lo:400:kworker.0 Request processed in 24us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985558.241384:0:13641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973688576 00000100:00100000:1.0:1788985558.241384:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796 00000100:00100000:2.0:1788985558.241386:0:13641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973688576 00000100:00100000:2.0:1788985558.241398:0:13641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:1.0:1788985558.241473:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:2.0:1788985558.241476:0:13641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973687424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985558.241479:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973688576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788985558.241502:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788985558.241505:0:13641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973687424:12345-0@lo:400:kworker.0 Request processed in 33us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985558.241510:0:13641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:1.0:1788985558.241528:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973688576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985558.241533:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00080000:1.0:1788985558.241548:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788985558.241551:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985558.241553:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985558.241577:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973687808:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.241604:0:8545:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973688320:12345-0@lo:400:kworker.0 Request processed in 684us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985558.241609:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973688320:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.241616:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1788985558.241673:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875885973687040:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.241682:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875885973687552:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.241690:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875885973688064:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.241704:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973688576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788985558.241711:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:18d53938-9833-4a4f-b2bc-80656579f00f:3641:1875885973686912:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.241719:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973687424:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.241729:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973687936:0@lo:400:kworker.0 00000100:00100000:3.0:1788985558.241740:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973688448:0@lo:13:osp-pre-1-1.0 00000020:00000080:0.0:1788985558.672805:0:57469:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2e9772c0 20000000:00000080:0.0:1788985558.672829:0:57469:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b1144024c00 uarg=0000000000000000 10000000:01000000:0.0:1788985558.673035:0:57469:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985558.673062:0:57469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12677e9400/0xa0dd3253da53052c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985558.673080:0:57469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12677e9400/0xa0dd3253da53052c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985558.673102:0:57469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12677e9400/0xa0dd3253da53052c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985558.673110:0:57469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12677e9400/0xa0dd3253da53052c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985558.673117:0:57469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12677e9400/0xa0dd3253da53052c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985558.673125:0:57469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12677e9400/0xa0dd3253da53052c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985558.673131:0:57469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12677e9400 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:0.0:1788985558.673136:0:57469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12677e9400/0xa0dd3253da53052c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985558.673144:0:57469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12677e9400/0xa0dd3253da53052c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985558.673157:0:57469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12677e9400/0xa0dd3253da53052c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985558.673164:0:57469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12677e9400/0xa0dd3253da53052c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985558.673172:0:57469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12677e9400/0xa0dd3253da53052c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985559.079006:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788985559.776007:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788985559.776015:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b1262230000 from 1 10000000:01000000:2.0:1788985559.776021:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788985559.776077:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985559.776089:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985559.776100:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985559.776127:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277eb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973688704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788985559.776193:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985559.776256:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b1245921d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788985559.776284:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973688704 00000100:00100000:2.0:1788985559.776291:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973688704 00000100:00100000:2.0:1788985559.776337:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:2.0:1788985559.776345:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1267768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18d53938-9833-4a4f-b2bc-80656579f00f+23:6511:x1875885973688704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985559.776360:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985559.776371:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b11433eb200/0xa0dd3253da53053a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0dd3253da530533 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985559.776394:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b11433eb200/0xa0dd3253da53053a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0dd3253da530533 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985559.776404:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b11433eb200/0xa0dd3253da53053a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da530533 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985559.776413:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b11433eb200, rc 0) 00000100:00100000:2.0:1788985559.776452:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1267768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18d53938-9833-4a4f-b2bc-80656579f00f+24:6511:x1875885973688704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985559.776458:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:2.0:1788985559.776752:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277eb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973688704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985559.776768:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da53053a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985559.776779:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0dd3253da53053a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985559.776800:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788985559.776804:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da53053a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985559.776823:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da53053a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985560.095382:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985561.124666:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985561.311150:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973688832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788985561.311247:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985561.311668:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973688832 00000100:00100000:1.0:1788985561.311677:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973688832 00000100:00100000:1.0:1788985561.311744:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1788985561.311763:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973688832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788985561.311793:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788985561.311845:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973688832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985561.311853:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1788985561.311904:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973688832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788985561.312075:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788985561.312084:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973688960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788985561.312114:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985561.312140:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973688960 00000100:00100000:1.0:1788985561.312145:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973688960 00000100:00100000:1.0:1788985561.312166:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1788985561.312173:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973688960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788985561.312184:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788985561.312236:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973688960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985561.312243:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1788985561.312283:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973688960:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788985561.312453:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985561.837978:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12500c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973689088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788985561.838050:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985561.838215:0:13641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973689088 00000100:00100000:3.0:1788985561.838224:0:13641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973689088 00000100:00100000:3.0:1788985561.838272:0:13641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:3.0:1788985561.838280:0:13641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973689088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788985561.838311:0:13641:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788985561.838355:0:13641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973689088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985561.838362:0:13641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1788985561.838579:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12500c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973689088:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788985562.145868:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788985562.751437:0:57665:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea5100d60 20000000:00000080:1.0:1788985562.751453:0:57665:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b126e9f4000 uarg=0000000000000000 00010000:00010000:1.0:1788985562.751753:0:57665:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985562.751771:0:57665:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985562.751798:0:57665:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985562.751809:0:57665:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788985562.751823:0:57665:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985562.751845:0:57665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985562.751866:0:57665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b11433eb200/0xa0dd3253da53053a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da530533 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985562.751874:0:57665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985562.751913:0:57665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b11433eb200/0xa0dd3253da53053a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0dd3253da530533 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985562.751923:0:57665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b11433eb200/0xa0dd3253da53053a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0dd3253da530533 expref: 23 pid: 6508 timeout: 1502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985562.751967:0:57665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57665:1875885973689216:0@lo:104: 00000100:00100000:1.0:1788985562.752021:0:57665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985562.752305:0:57665:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b125904d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788985562.752764:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973689216 00000100:00100000:3.0:1788985562.752779:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973689216 00000100:00100000:3.0:1788985562.752828:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788985562.752835:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:18d53938-9833-4a4f-b2bc-80656579f00f+3:57665:x1875885973689216:12345-0@lo:104: 00010000:00010000:3.0:1788985562.752847:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da53053a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985562.752909:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788985562.752915:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:18d53938-9833-4a4f-b2bc-80656579f00f+3:57665:x1875885973689216:12345-0@lo:104: Request processed in 80us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985562.752922:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788985562.752957:0:57665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57665:1875885973689216:0@lo:104: 00010000:00010000:2.0:1788985562.752959:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985562.752966:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da53053a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.752975:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b11433ea600 already unused, calling callback (ffffffffc13e9c20) 00010000:00010000:0.0:1788985562.752978:0:57665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985562.752979:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0dd3253da53053a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.752988:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0dd3253da53053a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985562.752995:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0dd3253da53053a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985562.753002:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985562.753038:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da53053a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753044:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985562.753077:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da53053a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753084:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff8b11433ea600/0xa0dd3253da530533 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da53053a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753100:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985562.753108:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985562.753111:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985562.753139:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:18d53938-9833-4a4f-b2bc-80656579f00f:3642:1875885973689344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788985562.753172:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985562.753231:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973689344 00000100:00100000:2.0:1788985562.753235:0:10333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973689344 00010000:00010000:2.0:1788985562.753251:0:10333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b11433eb200/0xa0dd3253da53053a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da530533 expref: 24 pid: 6508 timeout: 1502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985562.753273:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788985562.753280:0:10333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18d53938-9833-4a4f-b2bc-80656579f00f+24:3642:x1875885973689344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985562.753290:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985562.753296:0:10333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b11433eb200/0xa0dd3253da53053a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da530533 expref: 24 pid: 6508 timeout: 1502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753306:0:10333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b11433eb200/0xa0dd3253da53053a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0dd3253da530533 expref: 24 pid: 6508 timeout: 1502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753319:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b11433eb200/0xa0dd3253da53053a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0dd3253da530533 expref: 24 pid: 6508 timeout: 1502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753331:0:10333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753337:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753347:0:10333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753352:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753356:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753366:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753369:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12617eb600 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:2.0:1788985562.753372:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753376:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753389:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985562.753399:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985562.753412:0:57665:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985562.753420:0:57665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985562.753426:0:57665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12617eb600/0xa0dd3253da530541 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985562.753433:0:10333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18d53938-9833-4a4f-b2bc-80656579f00f+23:3642:x1875885973689344:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985562.753440:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788985562.753464:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:18d53938-9833-4a4f-b2bc-80656579f00f:3642:1875885973689344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985563.166555:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985563.193430:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788985563.193464:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788985563.193485:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788985563.193511:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953232256 00000100:00100000:0.0:1788985563.193520:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953232256 00000100:00100000:0.0:1788985563.193569:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953232384 00000100:00100000:0.0:1788985563.193571:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953232384 00000100:00100000:0.0:1788985563.193589:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1797 00000100:00100000:0.0:1788985563.193598:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2390:x1875885953232256:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788985563.193663:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2390:x1875885953232256:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 66us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985563.193670:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1797 00000100:00100000:0.0:1788985563.193687:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1798 00000100:00100000:0.0:1788985563.193693:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2391:x1875885953232384:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788985563.193718:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2391:x1875885953232384:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985563.193737:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1798 00000100:00080000:0.0:1788985563.193758:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788985563.193762:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788985563.194892:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953232128 00000100:00100000:3.0:1788985563.194900:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953232128 00000100:00100000:3.0:1788985563.195002:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 913 00000100:00100000:3.0:1788985563.195012:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126776bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2391:x1875885953232128:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788985563.195726:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126776bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2391:x1875885953232128:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 712us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985563.195735:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 913 00000100:00100000:1.0:1788985563.359215:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788985563.359236:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973689728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985563.359302:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985563.359371:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973689728 00000100:00100000:1.0:1788985563.359378:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973689728 00000100:00100000:1.0:1788985563.359430:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1788985563.359451:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126ecb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973689728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985563.359479:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788985563.359525:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126ecb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973689728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985563.359531:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1788985563.359751:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973689728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985563.362630:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:18d53938-9833-4a4f-b2bc-80656579f00f:3642:1875885973689856:0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.362709:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985563.362747:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973690368:0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.362775:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985563.362803:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973690880:0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.362827:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985563.362852:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788985563.362859:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875885973690240:0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.362882:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985563.362897:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973690752:0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.362914:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985563.362946:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973691264:0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.362965:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985563.362993:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973689856 00000100:00100000:1.0:1788985563.363000:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973689856 00000100:00100000:1.0:1788985563.363045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1788985563.363053:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126cda7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+23:3642:x1875885973689856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.363096:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126cda7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+23:3642:x1875885973689856:12345-0@lo:400:kworker.0 Request processed in 44us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985563.363111:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1788985563.363144:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973690368 00000100:00100000:1.0:1788985563.363148:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973690368 00000100:00100000:1.0:1788985563.363178:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1788985563.363184:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973690368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.363228:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973690368:12345-0@lo:400:kworker.0 Request processed in 44us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985563.363234:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1788985563.363250:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973690880 00000100:00100000:1.0:1788985563.363253:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973690880 00000100:00100000:1.0:1788985563.363279:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973690752 00000100:00100000:1.0:1788985563.363281:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973690752 00000100:00100000:1.0:1788985563.363293:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973691264 00000100:00100000:1.0:1788985563.363295:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973691264 00000100:00100000:1.0:1788985563.363308:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1788985563.363314:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973690880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.363343:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973690880:12345-0@lo:400:kworker.0 Request processed in 29us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985563.363537:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1788985563.363550:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1788985563.363556:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973690752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.363585:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973690752:12345-0@lo:400:kworker.0 Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985563.363591:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1788985563.363601:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:1.0:1788985563.363606:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973691264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.363651:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973691264:12345-0@lo:400:kworker.0 Request processed in 34us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985563.363658:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:1.0:1788985563.363678:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973690240 00000100:00100000:1.0:1788985563.363681:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973690240 00000100:00100000:1.0:1788985563.363707:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1799 00000100:00100000:1.0:1788985563.363713:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875885973690240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.363740:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875885973690240:12345-0@lo:400:kworker.0 Request processed in 28us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985563.363746:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1799 00000100:00100000:1.0:1788985563.363893:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875885973690240:0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.363907:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973690752:0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.363916:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973691264:0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.363944:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:18d53938-9833-4a4f-b2bc-80656579f00f:3642:1875885973689856:0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.363954:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973690368:0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.363961:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973690880:0@lo:400:kworker.0 00000100:00080000:1.0:1788985563.365788:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788985563.365795:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788985563.366774:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12500c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973689472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788985563.366967:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985563.366999:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875885973689984:0@lo:400:kworker.0 00000100:00100000:3.0:1788985563.367023:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985563.367041:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875885973690496:0@lo:400:kworker.0 00000100:00100000:3.0:1788985563.367059:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985563.367074:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875885973691008:0@lo:400:kworker.0 00000100:00100000:3.0:1788985563.367091:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985563.367116:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788985563.367131:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973689600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788985563.367156:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985563.367172:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973690112:0@lo:400:kworker.0 00000100:00100000:3.0:1788985563.367190:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985563.367215:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875885973690624:0@lo:400:kworker.0 00000100:00100000:3.0:1788985563.367235:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985563.367249:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875885973691136:0@lo:400:kworker.0 00000100:00100000:3.0:1788985563.367267:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985563.367360:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973689472 00000100:00100000:1.0:1788985563.367368:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973689472 00000100:00100000:1.0:1788985563.367411:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973690112 00000100:00100000:1.0:1788985563.367414:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973690112 00000100:00100000:1.0:1788985563.367427:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:1.0:1788985563.367435:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12500c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875885973689472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788985563.367478:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788985563.367523:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12500c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875885973689472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985563.367530:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:1.0:1788985563.367544:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:1.0:1788985563.367549:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11440c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973690112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.367576:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11440c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973690112:12345-0@lo:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985563.367582:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:1.0:1788985563.367598:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973689600 00000100:00100000:1.0:1788985563.367602:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973689600 00000100:00100000:1.0:1788985563.367623:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1788985563.367628:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11440c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973689600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788985563.367642:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788985563.367896:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11440c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973689600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 268us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985563.367903:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1788985563.367921:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973689984 00000100:00100000:1.0:1788985563.367946:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973689984 00000100:00100000:1.0:1788985563.367964:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973690496 00000100:00100000:1.0:1788985563.367967:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973690496 00000100:00100000:1.0:1788985563.367984:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973691008 00000100:00100000:0.0:1788985563.368457:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973690624 00000100:00100000:0.0:1788985563.368462:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973690624 00000100:00100000:0.0:1788985563.368483:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973691136 00000100:00100000:0.0:1788985563.368485:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973691136 00000100:00100000:0.0:1788985563.368499:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800 00000100:00100000:0.0:1788985563.368505:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12500c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875885973689984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985563.368541:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12500c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875885973689984:12345-0@lo:400:kworker.0 Request processed in 36us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985563.368548:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800 00000100:00100000:0.0:1788985563.368558:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801 00000100:00100000:0.0:1788985563.368564:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12500c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875885973690496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985563.368585:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12500c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875885973690496:12345-0@lo:400:kworker.0 Request processed in 22us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985563.368590:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801 00000100:00100000:0.0:1788985563.368599:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:0.0:1788985563.368604:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11440cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875885973690624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985563.368624:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11440cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875885973690624:12345-0@lo:400:kworker.0 Request processed in 20us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985563.368629:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00000100:00100000:0.0:1788985563.368641:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803 00000100:00100000:3.0:1788985563.368777:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973689600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788985563.368789:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973690112:0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.368870:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973691008 00000100:00100000:1.0:1788985563.368893:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804 00000100:00100000:1.0:1788985563.368899:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12500c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875885973691008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985563.368949:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12500c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875885973691008:12345-0@lo:400:kworker.0 Request processed in 50us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985563.368965:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804 00000100:00080000:1.0:1788985563.368982:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788985563.368985:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985563.369189:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11440c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875885973691136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985563.369231:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11440c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875885973691136:12345-0@lo:400:kworker.0 Request processed in 47us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985563.369243:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803 00010000:00080000:3.0:1788985563.369728:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b1277e9c000 x1875885973690624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788985563.369741:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875885973690624:0@lo:400:kworker.0 00010000:00080000:3.0:1788985563.369758:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b1277e9d180 x1875885973691136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788985563.369766:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875885973691136:0@lo:400:kworker.0 00000100:00100000:3.0:1788985563.369780:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12500c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973689472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788985563.369790:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875885973689984:0@lo:400:kworker.0 00000100:00100000:3.0:1788985563.370230:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875885973690496:0@lo:400:kworker.0 00000100:00100000:3.0:1788985563.370246:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875885973691008:0@lo:400:kworker.0 00010000:00010000:2.0:1788985564.191269:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788985564.766018:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788985564.766025:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b1262230000 from 1 10000000:01000000:0.0:1788985564.766030:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788985564.766073:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985564.766087:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985564.766170:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985564.766232:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973691392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788985564.766429:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985564.766538:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b1141937600 going to sleep for 11 seconds 00000100:00100000:3.0:1788985564.770384:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973691392 00000100:00100000:3.0:1788985564.770408:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973691392 00000100:00100000:3.0:1788985564.770467:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:3.0:1788985564.770476:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126cda4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18d53938-9833-4a4f-b2bc-80656579f00f+23:6511:x1875885973691392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788985564.770491:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788985564.770520:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b12463c7800/0xa0dd3253da53054f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0dd3253da530548 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985564.770546:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12463c7800/0xa0dd3253da53054f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0dd3253da530548 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985564.770557:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b12463c7800/0xa0dd3253da53054f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da530548 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985564.770565:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b12463c7800, rc 0) 00000100:00100000:3.0:1788985564.770632:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126cda4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18d53938-9833-4a4f-b2bc-80656579f00f+24:6511:x1875885973691392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (4204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985564.770641:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:0.0:1788985564.770967:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973691392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985564.770986:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da53054f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985564.770997:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0dd3253da53054f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985564.771017:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788985564.771023:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da53054f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985564.771031:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da53054f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985565.218347:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788985565.888795:0:57860:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc4cf48a0 20000000:00000080:1.0:1788985565.888813:0:57860:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b126fb4d000 uarg=0000000000000000 00010000:00010000:1.0:1788985565.889055:0:57860:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985565.889073:0:57860:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985565.889103:0:57860:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985565.889114:0:57860:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788985565.889127:0:57860:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985565.889148:0:57860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985565.889177:0:57860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b12463c7800/0xa0dd3253da53054f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da530548 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985565.889186:0:57860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985565.889225:0:57860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b12463c7800/0xa0dd3253da53054f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0dd3253da530548 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985565.889238:0:57860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b12463c7800/0xa0dd3253da53054f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0dd3253da530548 expref: 23 pid: 6509 timeout: 1505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985565.889254:0:57860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57860:1875885973691520:0@lo:104: 00000100:00100000:1.0:1788985565.889315:0:57860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985565.889552:0:57860:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b124627d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788985565.889830:0:26567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973691520 00000100:00100000:3.0:1788985565.889838:0:26567:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973691520 00000100:00100000:3.0:1788985565.889890:0:26567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788985565.889899:0:26567:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:18d53938-9833-4a4f-b2bc-80656579f00f+3:57860:x1875885973691520:12345-0@lo:104: 00010000:00010000:3.0:1788985565.889912:0:26567:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da53054f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985565.890011:0:26567:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788985565.890018:0:26567:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:18d53938-9833-4a4f-b2bc-80656579f00f+3:57860:x1875885973691520:12345-0@lo:104: Request processed in 120us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985565.890025:0:26567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788985565.890216:0:57860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57860:1875885973691520:0@lo:104: 00010000:00010000:1.0:1788985565.890246:0:57860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.890365:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985565.890372:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da53054f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.890490:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12677e8c00 already unused, calling callback (ffffffffc13e9c20) 10000000:00010000:0.0:1788985565.890493:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0dd3253da53054f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.890501:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0dd3253da53054f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788985565.890509:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0dd3253da53054f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985565.890514:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788985565.890550:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da53054f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.890556:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788985565.890585:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da53054f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.890591:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff8b12677e8c00/0xa0dd3253da530548 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da53054f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.890606:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985565.890607:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985565.890609:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985565.890651:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788985565.890669:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:18d53938-9833-4a4f-b2bc-80656579f00f:3641:1875885973691648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788985565.890703:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985565.890843:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973691648 00000100:00100000:0.0:1788985565.890854:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973691648 00010000:00010000:0.0:1788985565.890876:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b12463c7800/0xa0dd3253da53054f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da530548 expref: 24 pid: 6509 timeout: 1505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985565.890908:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788985565.890915:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b11440c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18d53938-9833-4a4f-b2bc-80656579f00f+24:3641:x1875885973691648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985565.891077:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985565.891222:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b12463c7800/0xa0dd3253da53054f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da530548 expref: 24 pid: 6509 timeout: 1505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.891233:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b12463c7800/0xa0dd3253da53054f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0dd3253da530548 expref: 24 pid: 6509 timeout: 1505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.891245:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12463c7800/0xa0dd3253da53054f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0dd3253da530548 expref: 24 pid: 6509 timeout: 1505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.891258:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.891267:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.891283:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.891289:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.891295:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.891301:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.891313:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12617ea400 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:0.0:1788985565.891318:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.891326:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.891345:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985565.891354:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788985565.891504:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b11440c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18d53938-9833-4a4f-b2bc-80656579f00f+23:3641:x1875885973691648:12345-0@lo:103:ldlm_bl.0 Request processed in 588us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985565.891511:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788985565.891571:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:18d53938-9833-4a4f-b2bc-80656579f00f:3641:1875885973691648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985565.891618:0:57860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985565.891628:0:57860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985565.891634:0:57860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530556 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985566.243777:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985566.431397:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788985566.431423:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973691776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788985566.431489:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985566.431550:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973691776 00000100:00100000:2.0:1788985566.431557:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973691776 00000100:00100000:2.0:1788985566.431608:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:2.0:1788985566.431618:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973691776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788985566.431647:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788985566.431704:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973691776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985566.431712:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:2.0:1788985566.431762:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973691776:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788985566.432199:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985566.434473:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788985566.434495:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12500c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973691904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788985566.434558:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985566.434645:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973691904 00000100:00100000:3.0:1788985566.434652:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973691904 00000100:00100000:3.0:1788985566.434714:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1788985566.434723:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973691904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788985566.434746:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788985566.434793:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973691904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985566.434799:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1788985566.434842:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12500c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973691904:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788985566.434896:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788985566.657745:0:57908:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd15054440 20000000:00000080:3.0:1788985566.657762:0:57908:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b114301a800 uarg=0000000000000000 00010000:00010000:3.0:1788985566.658057:0:57908:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788985566.658144:0:57908:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1142cc6000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788985566.658182:0:57908:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788985566.658194:0:57908:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b1277d0f800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788985566.658208:0:57908:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788985566.658228:0:57908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12463c7000/0xa0dd3253da53055d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985566.658243:0:57908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12463c7000/0xa0dd3253da53055d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985566.658254:0:57908:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c7000/0xa0dd3253da53055d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985566.658270:0:57908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12463c7000/0xa0dd3253da53055d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985566.658278:0:57908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12463c7000/0xa0dd3253da53055d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985566.658286:0:57908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12463c7000/0xa0dd3253da53055d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985566.658291:0:57908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12463c7000 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:3.0:1788985566.658296:0:57908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12463c7000/0xa0dd3253da53055d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985566.658305:0:57908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12463c7000/0xa0dd3253da53055d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985566.658318:0:57908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12463c7000/0xa0dd3253da53055d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985566.658445:0:57908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12463c7000/0xa0dd3253da53055d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985566.658451:0:57908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12463c7000/0xa0dd3253da53055d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985566.942270:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788985566.942293:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12500c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973692032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788985566.942364:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985566.944251:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973692032 00000100:00100000:2.0:1788985566.944266:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973692032 00000100:00100000:2.0:1788985566.944325:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1788985566.944335:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973692032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788985566.944380:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788985566.944459:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973692032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985566.944466:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1788985566.944903:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12500c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973692032:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788985567.262198:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788985567.646024:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788985567.646030:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b1262230000 from 1 10000000:01000000:2.0:1788985567.646034:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788985567.646094:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985567.646105:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985567.646116:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985567.646142:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973692160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788985567.646219:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985567.646278:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b1143305000 going to sleep for 11 seconds 00000100:00100000:1.0:1788985567.646397:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973692160 00000100:00100000:1.0:1788985567.646406:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973692160 00000100:00100000:1.0:1788985567.646462:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1788985567.646473:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126cda6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18d53938-9833-4a4f-b2bc-80656579f00f+23:6511:x1875885973692160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985567.646485:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985567.646497:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b12617ea400/0xa0dd3253da53056b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0dd3253da530564 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985567.646540:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12617ea400/0xa0dd3253da53056b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0dd3253da530564 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985567.646551:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b12617ea400/0xa0dd3253da53056b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da530564 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985567.646560:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b12617ea400, rc 0) 00000100:00100000:1.0:1788985567.646608:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126cda6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18d53938-9833-4a4f-b2bc-80656579f00f+24:6511:x1875885973692160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985567.646615:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:2.0:1788985567.646764:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973692160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985567.646786:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da53056b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985567.646795:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0dd3253da53056b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985567.646813:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788985567.646817:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da53056b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985567.646824:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da53056b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985568.287041:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985568.310572:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788985568.310658:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953232512 00000100:00100000:1.0:1788985568.310668:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953232512 00000100:00100000:1.0:1788985568.310768:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 917 00000100:00100000:1.0:1788985568.310779:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126cda7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2390:x1875885953232512:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788985568.310861:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126cda7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2390:x1875885953232512:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 83us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.310870:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 917 00000100:00100000:0.0:1788985568.319374:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788985568.319439:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953232640 00000100:00100000:1.0:1788985568.319449:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953232640 00000100:00100000:1.0:1788985568.319518:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1805 00000100:00100000:1.0:1788985568.319528:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2390:x1875885953232640:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788985568.319594:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2390:x1875885953232640:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 69us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.319601:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1805 00000100:00080000:0.0:1788985568.321452:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985568.334210:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788985568.334303:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953232768 00000100:00100000:1.0:1788985568.334337:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953232768 00000100:00100000:1.0:1788985568.334425:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1806 00000100:00100000:1.0:1788985568.334437:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2391:x1875885953232768:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788985568.334536:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2391:x1875885953232768:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 101us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.334544:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1806 00000100:00080000:2.0:1788985568.334708:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788985568.482418:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12500c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973692288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788985568.482489:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985568.482561:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114485fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973692416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788985568.482586:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985568.482636:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973692288 00000100:00100000:3.0:1788985568.482644:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973692288 00000100:00100000:3.0:1788985568.482685:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:3.0:1788985568.482695:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114485e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973692288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788985568.482728:0:6519:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788985568.482773:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114485e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973692288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985568.482780:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:3.0:1788985568.482801:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973692416 00000100:00100000:3.0:1788985568.482804:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973692416 00000100:00100000:3.0:1788985568.482834:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1788985568.482841:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114485c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973692416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788985568.482858:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788985568.482889:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114485c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973692416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985568.482895:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00080000:3.0:1788985568.482913:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788985568.482970:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114485fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973692416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788985568.483007:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12500c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973692288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788985568.484580:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1143b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973692544:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.484640:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985568.484674:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875885973693056:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.484696:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985568.484714:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875885973693568:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.484732:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985568.484752:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788985568.484757:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973692928:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.484778:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985568.484794:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973693440:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.484813:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985568.484827:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973693952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985568.484846:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985568.484871:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973692544 00000100:00100000:1.0:1788985568.484877:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973692544 00000100:00100000:1.0:1788985568.484914:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1788985568.484922:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126cda4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18d53938-9833-4a4f-b2bc-80656579f00f+24:3640:x1875885973692544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.484984:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126cda4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18d53938-9833-4a4f-b2bc-80656579f00f+24:3640:x1875885973692544:12345-0@lo:400:kworker.0 Request processed in 62us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.485002:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1788985568.485033:0:10354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973693056 00000100:00100000:1.0:1788985568.485037:0:10354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973693056 00000100:00100000:1.0:1788985568.485066:0:10354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973693568 00000100:00100000:1.0:1788985568.485070:0:10354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973693568 00000100:00100000:1.0:1788985568.485088:0:10354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807 00000100:00100000:1.0:1788985568.485094:0:10354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875885973693056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.485125:0:10354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875885973693056:12345-0@lo:400:kworker.0 Request processed in 31us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.485152:0:10354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807 00000100:00100000:1.0:1788985568.485165:0:10354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808 00000100:00100000:1.0:1788985568.485171:0:10354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875885973693568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.485484:0:10354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875885973693568:12345-0@lo:400:kworker.0 Request processed in 312us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.485491:0:10354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808 00000100:00100000:1.0:1788985568.485512:0:13641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973692928 00000100:00100000:1.0:1788985568.485515:0:13641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973692928 00000100:00100000:1.0:1788985568.485544:0:13641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1788985568.485550:0:13641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973692928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.485579:0:13641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973692928:12345-0@lo:400:kworker.0 Request processed in 30us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.485584:0:13641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1788985568.485599:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973693440 00000100:00100000:1.0:1788985568.485601:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973693440 00000100:00100000:1.0:1788985568.485624:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1788985568.485629:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973693440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.485664:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973693440:12345-0@lo:400:kworker.0 Request processed in 35us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.485671:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1788985568.485686:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973693952 00000100:00100000:1.0:1788985568.485689:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973693952 00000100:00100000:1.0:1788985568.485712:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:1.0:1788985568.485717:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973693952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985568.485731:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788985568.485756:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973693952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.485762:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:1.0:1788985568.485800:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973692928:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.485809:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973693440:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.485820:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973693952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985568.485828:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1143b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973692544:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.485836:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875885973693056:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.485844:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875885973693568:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.485870:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875885973692672:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.485891:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985568.485909:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875885973693184:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.485948:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985568.485961:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875885973693696:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.485988:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985568.486003:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788985568.486008:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875885973692800:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.486023:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985568.486034:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973693312:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.486049:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985568.486060:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973693824:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.486072:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985568.486089:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973692672 00000100:00100000:1.0:1788985568.486093:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973692672 00000100:00100000:1.0:1788985568.486110:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973693184 00000100:00100000:1.0:1788985568.486112:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973693184 00000100:00100000:1.0:1788985568.486123:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973693696 00000100:00100000:1.0:1788985568.486124:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973693696 00000100:00100000:1.0:1788985568.486133:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973692800 00000100:00100000:1.0:1788985568.486135:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973692800 00000100:00100000:1.0:1788985568.486160:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809 00000100:00100000:1.0:1788985568.486166:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875885973692672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.486618:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875885973692672:12345-0@lo:400:kworker.0 Request processed in 29us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.486625:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809 00000100:00100000:1.0:1788985568.486639:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810 00000100:00100000:1.0:1788985568.486645:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875885973693184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.486676:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875885973693184:12345-0@lo:400:kworker.0 Request processed in 32us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.486681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810 00000100:00100000:1.0:1788985568.486691:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811 00000100:00100000:1.0:1788985568.486701:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1143b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875885973693696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.486725:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1143b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875885973693696:12345-0@lo:400:kworker.0 Request processed in 24us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.486730:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811 00000100:00100000:1.0:1788985568.486739:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:1.0:1788985568.486744:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875885973692800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.486762:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875885973692800:12345-0@lo:400:kworker.0 Request processed in 19us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.486767:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:1.0:1788985568.486787:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973693312 00000100:00100000:1.0:1788985568.486790:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973693312 00000100:00100000:1.0:1788985568.486810:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973693824 00000100:00100000:1.0:1788985568.486812:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973693824 00000100:00100000:1.0:1788985568.486823:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1788985568.486828:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973693312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.486852:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973693312:12345-0@lo:400:kworker.0 Request processed in 24us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.486858:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1788985568.486867:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1788985568.486871:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973693824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.486889:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973693824:12345-0@lo:400:kworker.0 Request processed in 17us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985568.486893:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1788985568.486922:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875885973692800:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.486947:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973693312:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.486963:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973693824:0@lo:400:kworker.0 00000100:00100000:1.0:1788985568.486970:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875885973692672:0@lo:400:kworker.0 00010000:00080000:1.0:1788985568.486980:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b1277e9c000 x1875885973693184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788985568.486989:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875885973693184:0@lo:400:kworker.0 00010000:00080000:1.0:1788985568.486997:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b1277e9fb80 x1875885973693696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788985568.487004:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875885973693696:0@lo:400:kworker.0 00000100:00080000:1.0:1788985568.487026:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788985568.487030:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985568.487032:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788985568.487034:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788985569.311378:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985570.334157:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788985571.267810:0:58200:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc58ac0d00 20000000:00000080:1.0:1788985571.267829:0:58200:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b1143340000 uarg=0000000000000000 10000000:01000000:1.0:1788985571.267882:0:58200:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985571.267903:0:58200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985571.267921:0:58200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b12617ea400/0xa0dd3253da53056b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da530564 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985571.269400:0:58200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985571.269452:0:58200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b12617ea400/0xa0dd3253da53056b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0dd3253da530564 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985571.269482:0:58200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b12617ea400/0xa0dd3253da53056b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0dd3253da530564 expref: 23 pid: 6508 timeout: 1511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985571.269499:0:58200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58200:1875885973694080:0@lo:104: 00000100:00100000:1.0:1788985571.269574:0:58200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985571.269636:0:58200:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b127d19a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788985571.269754:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788985571.269769:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973694080 00000100:00100000:3.0:1788985571.269776:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973694080 00000100:00100000:3.0:1788985571.269828:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788985571.269835:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:18d53938-9833-4a4f-b2bc-80656579f00f+3:58200:x1875885973694080:12345-0@lo:104: 00010000:00010000:3.0:1788985571.269845:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da53056b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985571.269906:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788985571.269910:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:18d53938-9833-4a4f-b2bc-80656579f00f+3:58200:x1875885973694080:12345-0@lo:104: Request processed in 76us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985571.269916:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00010000:00010000:0.0:1788985571.270027:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985571.270034:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da53056b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270042:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b11433eb800 already unused, calling callback (ffffffffc13e9c20) 10000000:00010000:0.0:1788985571.270047:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0dd3253da53056b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270056:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0dd3253da53056b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788985571.270075:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0dd3253da53056b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985571.270080:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788985571.270130:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da53056b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270137:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788985571.270160:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da53056b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270167:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff8b11433eb800/0xa0dd3253da530564 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da53056b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270183:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985571.270185:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985571.270186:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985571.270199:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973694208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985571.270230:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985571.270273:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973694208 00000100:00100000:0.0:1788985571.270277:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973694208 00010000:00010000:0.0:1788985571.270297:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b12617ea400/0xa0dd3253da53056b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da530564 expref: 24 pid: 6508 timeout: 1511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985571.270318:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788985571.270326:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18d53938-9833-4a4f-b2bc-80656579f00f+24:3640:x1875885973694208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985571.270336:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985571.270341:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b12617ea400/0xa0dd3253da53056b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da530564 expref: 24 pid: 6508 timeout: 1511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270357:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b12617ea400/0xa0dd3253da53056b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0dd3253da530564 expref: 24 pid: 6508 timeout: 1511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270374:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270382:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270398:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270406:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270413:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270419:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270425:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12617eac00 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:0.0:1788985571.270429:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270437:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270445:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985571.270465:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788985571.270494:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18d53938-9833-4a4f-b2bc-80656579f00f+24:3640:x1875885973694208:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985571.270501:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788985571.270541:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973694208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985571.270720:0:58200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12617ea400/0xa0dd3253da53056b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0dd3253da530564 expref: 23 pid: 6508 timeout: 1511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985571.270732:0:58200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58200:1875885973694080:0@lo:104: 00010000:00010000:1.0:1788985571.270748:0:58200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985571.270757:0:58200:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985571.270764:0:58200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985571.270770:0:58200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530572 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985571.359226:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985571.551128:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973694336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788985571.551199:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985571.551278:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973694336 00000100:00100000:3.0:1788985571.551286:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973694336 00000100:00100000:3.0:1788985571.551338:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:3.0:1788985571.551347:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114485fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973694336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788985571.551374:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788985571.551416:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114485fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973694336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985571.551423:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00080000:3.0:1788985571.551443:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788985571.551478:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973694336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788985571.551828:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973694464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788985571.551857:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985571.551955:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973694464 00000100:00100000:2.0:1788985571.551960:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973694464 00000100:00100000:2.0:1788985571.551993:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:2.0:1788985571.552000:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114485ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973694464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985571.552010:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788985571.552054:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114485ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875885973694464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985571.552060:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00080000:3.0:1788985571.552177:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788985571.552202:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875885973694464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985572.062581:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114485e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973694592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788985572.062656:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985572.063407:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973694592 00000100:00100000:3.0:1788985572.063419:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973694592 00000100:00100000:3.0:1788985572.063475:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:3.0:1788985572.063484:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973694592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788985572.063531:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788985572.063608:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973694592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985572.063615:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1788985572.063985:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114485e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973694592:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1788985572.315665:0:58249:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde8e05e40 20000000:00000080:1.0:1788985572.315683:0:58249:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b1143343c00 uarg=0000000000000000 10000000:01000000:1.0:1788985572.315736:0:58249:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985572.315757:0:58249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530579 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.315773:0:58249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530579 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 58249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.315791:0:58249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530579 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.315798:0:58249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530579 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.315805:0:58249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530579 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.315812:0:58249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530579 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.315818:0:58249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12617eac00 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:1.0:1788985572.315822:0:58249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530579 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.315830:0:58249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530579 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.315844:0:58249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530579 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.315852:0:58249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530579 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.315859:0:58249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12617eac00/0xa0dd3253da530579 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.382264:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788985572.510014:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788985572.510022:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b1262230000 from 1 10000000:01000000:3.0:1788985572.510027:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788985572.510072:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985572.510083:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985572.510094:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985572.510131:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114485c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973694720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788985572.510202:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985572.510329:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973694720 00000100:00100000:1.0:1788985572.510347:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973694720 00000100:00100000:1.0:1788985572.510394:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:1.0:1788985572.510403:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126cda5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+23:6511:x1875885973694720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985572.510417:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985572.510429:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530587 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0dd3253da530580 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.510451:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530587 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0dd3253da530580 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.510461:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530587 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da530580 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985572.510469:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b12617ea400, rc 0) 00000100:00100000:1.0:1788985572.510502:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126cda5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+24:6511:x1875885973694720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985572.510509:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:3.0:1788985572.511387:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b11438133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788985572.511418:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114485c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973694720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788985572.511438:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da530587 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985572.511449:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0dd3253da530587 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788985572.511469:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788985572.511474:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da530587 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985572.511491:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da530587 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985573.407188:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985573.445185:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788985573.445225:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788985573.445247:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953232896 00000100:00100000:0.0:1788985573.445247:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788985573.445257:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953232896 00000100:00100000:3.0:1788985573.445311:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 920 00000100:00100000:3.0:1788985573.445323:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126cda5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2388:x1875885953232896:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788985573.445401:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126cda5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2388:x1875885953232896:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 80us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985573.445409:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 920 00000100:00100000:0.0:1788985573.445969:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953233024 00000100:00100000:0.0:1788985573.445975:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953233024 00000100:00100000:0.0:1788985573.446067:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953233152 00000100:00100000:0.0:1788985573.446070:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953233152 00000100:00100000:0.0:1788985573.446092:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1813 00000100:00100000:0.0:1788985573.446111:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2389:x1875885953233024:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788985573.446150:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2389:x1875885953233024:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 52us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985573.446157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1813 00000100:00100000:0.0:1788985573.446171:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1814 00000100:00100000:0.0:1788985573.446178:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2388:x1875885953233152:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788985573.446205:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2388:x1875885953233152:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985573.446223:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1814 00000100:00080000:0.0:1788985573.446247:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788985573.447091:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985573.598048:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788985573.598071:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973694848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985573.598161:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985573.598230:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973694848 00000100:00100000:1.0:1788985573.598239:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973694848 00000100:00100000:1.0:1788985573.598307:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1788985573.598319:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973694848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985573.598347:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788985573.598394:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973694848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985573.598401:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00080000:1.0:1788985573.598438:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985573.598477:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973694848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985573.598743:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:18d53938-9833-4a4f-b2bc-80656579f00f:3641:1875885973694976:0@lo:400:kworker.0 00000100:00100000:0.0:1788985573.598776:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985573.598798:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973695488:0@lo:400:kworker.0 00000100:00100000:0.0:1788985573.598819:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985573.598831:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973696000:0@lo:400:kworker.0 00000100:00100000:0.0:1788985573.598852:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985573.598868:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788985573.598873:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875885973695104:0@lo:400:kworker.0 00000100:00100000:0.0:1788985573.598896:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985573.598911:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875885973695616:0@lo:400:kworker.0 00000100:00100000:0.0:1788985573.598955:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985573.598973:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875885973696128:0@lo:400:kworker.0 00000100:00100000:0.0:1788985573.598993:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985573.599022:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973695104 00000100:00100000:0.0:1788985573.599026:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973695104 00000100:00100000:0.0:1788985573.599053:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973695616 00000100:00100000:0.0:1788985573.599056:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973695616 00000100:00100000:0.0:1788985573.599076:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973696128 00000100:00100000:0.0:1788985573.599079:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973696128 00000100:00100000:0.0:1788985573.599094:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815 00000100:00100000:0.0:1788985573.599113:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875885973695104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985573.599162:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875885973695104:12345-0@lo:400:kworker.0 Request processed in 50us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985573.599180:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815 00000100:00100000:0.0:1788985573.599196:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:0.0:1788985573.599203:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875885973695616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985573.599233:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875885973695616:12345-0@lo:400:kworker.0 Request processed in 31us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985573.599239:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000100:00100000:0.0:1788985573.599250:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:0.0:1788985573.599256:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875885973696128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985573.599354:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875885973696128:12345-0@lo:400:kworker.0 Request processed in 98us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985573.599360:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00100000:0.0:1788985573.599397:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875885973695104:0@lo:400:kworker.0 00000100:00100000:0.0:1788985573.599407:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875885973695616:0@lo:400:kworker.0 00000100:00100000:0.0:1788985573.599414:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875885973696128:0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.599531:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875885973695360:0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.599562:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985573.599589:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973695872:0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.599610:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985573.599624:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973696384:0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.599641:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985573.599656:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788985573.599663:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b12412abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973695232:0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.599684:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985573.599702:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875885973695744:0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.599721:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985573.599735:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875885973696256:0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.599751:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985573.599775:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973694976 00000100:00100000:2.0:1788985573.599780:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973694976 00000100:00100000:2.0:1788985573.599808:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:2.0:1788985573.599815:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126cda6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18d53938-9833-4a4f-b2bc-80656579f00f+24:3641:x1875885973694976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.599849:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126cda6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18d53938-9833-4a4f-b2bc-80656579f00f+24:3641:x1875885973694976:12345-0@lo:400:kworker.0 Request processed in 34us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985573.599854:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:2.0:1788985573.599881:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973695488 00000100:00100000:2.0:1788985573.599884:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973695488 00000100:00100000:2.0:1788985573.599904:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973695232 00000100:00100000:2.0:1788985573.599907:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973695232 00000100:00100000:2.0:1788985573.599917:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:2.0:1788985573.599922:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973695488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.599985:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973695488:12345-0@lo:400:kworker.0 Request processed in 62us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985573.599991:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:2.0:1788985573.600003:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1788985573.600009:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973695232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.600039:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973695232:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985573.600044:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1788985573.600077:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973695232:0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.600093:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973695360 00000100:00100000:2.0:1788985573.600107:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973695360 00000100:00100000:2.0:1788985573.600131:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973695744 00000100:00100000:2.0:1788985573.600134:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973695744 00000100:00100000:2.0:1788985573.600201:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973696256 00000100:00100000:2.0:1788985573.600204:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973696256 00000100:00100000:2.0:1788985573.600221:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818 00000100:00100000:2.0:1788985573.600226:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875885973695360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.600258:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875885973695360:12345-0@lo:400:kworker.0 Request processed in 32us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985573.600264:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818 00000100:00100000:2.0:1788985573.601514:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819 00000100:00100000:2.0:1788985573.601528:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875885973695744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.601582:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875885973695744:12345-0@lo:400:kworker.0 Request processed in 59us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985573.601588:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819 00000100:00100000:2.0:1788985573.601600:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820 00000100:00100000:2.0:1788985573.601617:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875885973696256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.601644:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875885973696256:12345-0@lo:400:kworker.0 Request processed in 29us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985573.601650:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820 00010000:00080000:2.0:1788985573.601687:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b114338d880 x1875885973695744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788985573.601699:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875885973695744:0@lo:400:kworker.0 00010000:00080000:2.0:1788985573.601709:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b114338ca80 x1875885973696256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788985573.601717:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875885973696256:0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.601726:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875885973695360:0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.601762:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:18d53938-9833-4a4f-b2bc-80656579f00f:3641:1875885973694976:0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.601771:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b12412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973695488:0@lo:400:kworker.0 00000100:00100000:1.0:1788985573.601872:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973696000 00000100:00100000:1.0:1788985573.601878:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973696000 00000100:00100000:1.0:1788985573.601921:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973695872 00000100:00100000:1.0:1788985573.601941:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973695872 00000100:00100000:1.0:1788985573.601954:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973696384 00000100:00100000:1.0:1788985573.601957:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973696384 00000100:00100000:1.0:1788985573.601968:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1788985573.601974:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973696000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985573.602012:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973696000:12345-0@lo:400:kworker.0 Request processed in 38us (3158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985573.602017:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1788985573.602028:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1788985573.602032:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973695872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985573.602058:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973695872:12345-0@lo:400:kworker.0 Request processed in 26us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985573.602063:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1788985573.602072:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1788985573.602077:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973696384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985573.602112:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973696384:12345-0@lo:400:kworker.0 Request processed in 34us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985573.602117:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1788985573.602158:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973695872:0@lo:400:kworker.0 00000100:00100000:1.0:1788985573.602168:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973696384:0@lo:400:kworker.0 00000100:00080000:1.0:1788985573.602185:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985573.602194:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788985573.602196:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788985573.602199:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985573.602216:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973696000:0@lo:400:kworker.0 00000100:00100000:2.0:1788985573.606359:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788985573.606382:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1247c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973696512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788985573.606448:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985573.606492:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973696512 00000100:00100000:2.0:1788985573.606500:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973696512 00000100:00100000:2.0:1788985573.606546:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1788985573.606556:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973696512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788985573.606580:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788985573.606625:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973696512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985573.606643:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1788985573.606691:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1247c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973696512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788985573.607022:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788985573.607033:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973696640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788985573.607066:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985573.607327:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973696640 00000100:00100000:0.0:1788985573.607333:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973696640 00000100:00100000:0.0:1788985573.607371:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:0.0:1788985573.607379:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973696640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788985573.607408:0:6519:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788985573.607447:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973696640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985573.607452:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:1.0:1788985573.608449:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973696640:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788985574.433186:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985575.466503:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985575.824151:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788985575.824180:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953233280 00000100:00100000:1.0:1788985575.824188:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953233280 00000100:00100000:1.0:1788985575.824248:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:1.0:1788985575.824258:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:434c316c-c59b-49ac-917b-d6d87006b1b1+5:6164:x1875885953233280:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788985575.824339:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788985575.824342:0:6501:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie a0dd3253da53046f) 00010000:00010000:1.0:1788985575.824343:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788985575.824382:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:434c316c-c59b-49ac-917b-d6d87006b1b1+5:6164:x1875885953233280:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 127us (242us total) trans 0 rc 116/116 00000100:00100000:1.0:1788985575.824387:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00080000:1.0:1788985575.824404:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985575.865413:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788985575.865505:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953233408 00000100:00100000:2.0:1788985575.865515:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953233408 00000100:00100000:2.0:1788985575.865610:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:2.0:1788985575.865621:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:35087:x1875885953233408:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:2.0:1788985575.865643:0:9790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985575.865666:0:9790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b11433ea000/0xa0dd3253da53058e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe077727b9e171ef expref: -99 pid: 9790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985575.865728:0:9790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b11433ebe00/0xa0dd3253da530595 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985575.865743:0:9790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b11433ebe00/0xa0dd3253da530595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985575.865756:0:9790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b11433ebe00/0xa0dd3253da530595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788985575.865801:0:9790:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788985575.865806:0:9790:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788985575.865829:0:9790:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b11433ebe00/0xa0dd3253da530595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985575.865854:0:9790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b11433ea000/0xa0dd3253da53058e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xbe077727b9e171ef expref: 7 pid: 9790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985575.865873:0:9790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b11433ebe00/0xa0dd3253da530595 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xbe077727b9e171ef expref: 6 pid: 9790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985575.865899:0:9790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b1143311300) 00010000:00010000:2.0:1788985575.865902:0:9790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788985575.865905:0:9790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b11433ebe00, rc 0) 00000100:00100000:2.0:1788985575.865989:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+6:35087:x1875885953233408:12345-192.168.202.6@tcp:101:rm.0 Request processed in 369us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985575.865996:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:3.0:1788985575.868856:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788985575.869165:0:10354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953233536 00000100:00100000:1.0:1788985575.869175:0:10354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953233536 00000100:00100000:1.0:1788985575.869240:0:10354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 95 00000100:00100000:1.0:1788985575.869251:0:10354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114485c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:434c316c-c59b-49ac-917b-d6d87006b1b1+6:35087:x1875885953233536:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:1.0:1788985575.869278:0:10354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985575.869311:0:10354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb800/0xa0dd3253da53059c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe077727b9e171f6 expref: -99 pid: 10354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869368:0:10354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb200/0xa0dd3253da5305a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869382:0:10354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb200/0xa0dd3253da5305a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869393:0:10354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb200/0xa0dd3253da5305a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869406:0:10354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea800/0xa0dd3253da5305aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869411:0:10354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea800/0xa0dd3253da5305aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869415:0:10354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea800/0xa0dd3253da5305aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869453:0:10354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb200/0xa0dd3253da5305a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869458:0:10354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb200/0xa0dd3253da5305a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869462:0:10354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb200/0xa0dd3253da5305a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869466:0:10354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12617eb200 already unused, calling callback (ffffffffc19fa4f0) 00010000:00010000:1.0:1788985575.869468:0:10354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb200/0xa0dd3253da5305a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869481:0:10354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb200/0xa0dd3253da5305a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869490:0:10354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b1143311300) 00010000:00010000:1.0:1788985575.869492:0:10354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985575.869495:0:10354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb200/0xa0dd3253da5305a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869499:0:10354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb200/0xa0dd3253da5305a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869508:0:10354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea800/0xa0dd3253da5305aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869512:0:10354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea800/0xa0dd3253da5305aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869516:0:10354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea800/0xa0dd3253da5305aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869518:0:10354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12617ea800 already unused, calling callback (ffffffffc19fa4f0) 00010000:00010000:1.0:1788985575.869520:0:10354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea800/0xa0dd3253da5305aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869523:0:10354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea800/0xa0dd3253da5305aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869526:0:10354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8b1243922400) 00010000:00010000:1.0:1788985575.869528:0:10354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985575.869529:0:10354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea800/0xa0dd3253da5305aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869538:0:10354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea800/0xa0dd3253da5305aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869561:0:10354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb800/0xa0dd3253da53059c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xbe077727b9e171f6 expref: 7 pid: 10354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869568:0:10354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b1143311300) 00010000:00010000:1.0:1788985575.869569:0:10354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985575.869571:0:10354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb800/0xa0dd3253da53059c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xbe077727b9e171f6 expref: 7 pid: 10354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985575.869576:0:10354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b12617eb800, rc 0) 00000100:00100000:1.0:1788985575.869629:0:10354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114485c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:434c316c-c59b-49ac-917b-d6d87006b1b1+6:35087:x1875885953233536:12345-192.168.202.6@tcp:101:rm.0 Request processed in 380us (782us total) trans 0 rc 301/301 00000100:00100000:1.0:1788985575.869635:0:10354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 95 00010000:00010000:0.0:1788985576.478122:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985576.672087:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1247c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973696896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788985576.672171:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985576.672241:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788985576.672248:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1247c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973696768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788985576.672495:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985576.672527:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973696896 00000100:00100000:2.0:1788985576.672535:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973696896 00000100:00100000:2.0:1788985576.672583:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973696768 00000100:00100000:2.0:1788985576.672586:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973696768 00000100:00100000:2.0:1788985576.672604:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:2.0:1788985576.672613:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114305dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973696896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788985576.672642:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788985576.672687:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114305dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973696896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985576.672694:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:2.0:1788985576.672711:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:2.0:1788985576.672716:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114305c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973696768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985576.672726:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788985576.672760:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114305c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973696768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985576.672780:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00080000:2.0:1788985576.672802:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788985576.672838:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1247c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973696768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788985576.672853:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1247c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973696896:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1788985576.818702:0:58445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb23dcf40 20000000:00000080:0.0:1788985576.818720:0:58445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b114334cc00 uarg=0000000000000000 10000000:01000000:0.0:1788985576.818777:0:58445:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985576.818796:0:58445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985576.818814:0:58445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530587 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da530580 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985576.818823:0:58445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985576.818862:0:58445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530587 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0dd3253da530580 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985576.818875:0:58445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530587 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0dd3253da530580 expref: 23 pid: 6506 timeout: 1516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985576.818889:0:58445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277ee6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58445:1875885973697024:0@lo:104: 00000100:00100000:0.0:1788985576.820196:0:58445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985576.820458:0:58445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b114331ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788985576.822651:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973697024 00000100:00100000:2.0:1788985576.822665:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973697024 00000100:00100000:3.0:1788985576.823461:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788985576.823474:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:18d53938-9833-4a4f-b2bc-80656579f00f+3:58445:x1875885973697024:12345-0@lo:104: 00010000:00010000:3.0:1788985576.823494:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da530587 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985576.823593:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788985576.823599:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:18d53938-9833-4a4f-b2bc-80656579f00f+3:58445:x1875885973697024:12345-0@lo:104: Request processed in 129us (3408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985576.823606:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00010000:00010000:2.0:1788985576.823656:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985576.823664:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0dd3253da530587 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.823671:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12463c7400 already unused, calling callback (ffffffffc13e9c20) 10000000:00010000:2.0:1788985576.823675:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0dd3253da530587 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.823685:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0dd3253da530587 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985576.823693:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0dd3253da530587 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985576.823699:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985576.823737:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da530587 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.823743:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985576.823764:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da530587 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.823773:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff8b12463c7400/0xa0dd3253da530580 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0dd3253da530587 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.823803:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985576.823805:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985576.823807:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985576.823815:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788985576.823829:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114305df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:18d53938-9833-4a4f-b2bc-80656579f00f:3642:1875885973697152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985576.823870:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985576.823911:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973697152 00000100:00100000:2.0:1788985576.823916:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973697152 00010000:00010000:2.0:1788985576.823975:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530587 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da530580 expref: 24 pid: 6506 timeout: 1516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985576.824010:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788985576.824017:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126ce50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18d53938-9833-4a4f-b2bc-80656579f00f+24:3642:x1875885973697152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985576.824028:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985576.824033:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530587 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0dd3253da530580 expref: 24 pid: 6506 timeout: 1516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.824057:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530587 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0dd3253da530580 expref: 24 pid: 6506 timeout: 1516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.824084:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.824092:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.824107:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.824123:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.824130:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.824136:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.824141:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12677e9600 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:2.0:1788985576.824144:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.824151:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.824160:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985576.824170:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985576.824199:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126ce50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18d53938-9833-4a4f-b2bc-80656579f00f+24:3642:x1875885973697152:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985576.824206:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788985576.824284:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114305df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:18d53938-9833-4a4f-b2bc-80656579f00f:3642:1875885973697152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985576.824410:0:58445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12617ea400/0xa0dd3253da530587 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0dd3253da530580 expref: 23 pid: 6506 timeout: 1516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985576.824423:0:58445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277ee6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58445:1875885973697024:0@lo:104: 00010000:00010000:0.0:1788985576.824436:0:58445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985576.824445:0:58445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985576.824462:0:58445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985576.824469:0:58445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12677e9600/0xa0dd3253da5305b1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985577.182667:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788985577.182698:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973697280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788985577.182793:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985577.183097:0:13641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973697280 00000100:00100000:2.0:1788985577.183109:0:13641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973697280 00000100:00100000:2.0:1788985577.183176:0:13641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:2.0:1788985577.183186:0:13641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973697280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788985577.183246:0:13641:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788985577.183396:0:13641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973697280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 211us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985577.183404:0:13641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:1.0:1788985577.183875:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973697280:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788985577.502315:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788985577.712617:0:58493:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0c907a30 20000000:00000080:1.0:1788985577.712645:0:58493:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8b1277e89000 uarg=0000000000000000 10000000:01000000:1.0:1788985577.712718:0:58493:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985577.712747:0:58493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b12617eba00/0xa0dd3253da5305b8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985577.712766:0:58493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12617eba00/0xa0dd3253da5305b8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 58493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985577.712790:0:58493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617eba00/0xa0dd3253da5305b8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985577.712797:0:58493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b12617eba00/0xa0dd3253da5305b8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985577.712804:0:58493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b12617eba00/0xa0dd3253da5305b8 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985577.712812:0:58493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b12617eba00/0xa0dd3253da5305b8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985577.712819:0:58493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12617eba00 already unused, calling callback (ffffffffc0de88b0) 00010000:00010000:1.0:1788985577.712824:0:58493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b12617eba00/0xa0dd3253da5305b8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985577.712832:0:58493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b12617eba00/0xa0dd3253da5305b8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985577.712848:0:58493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b12617eba00/0xa0dd3253da5305b8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985577.712856:0:58493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b12617eba00/0xa0dd3253da5305b8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985577.712864:0:58493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b12617eba00/0xa0dd3253da5305b8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985578.399006:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788985578.399015:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b1262230000 from 1 10000000:01000000:2.0:1788985578.399020:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788985578.399095:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b11433ea200/0xa0dd3253da5305bf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985578.399117:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff8b11433ea200/0xa0dd3253da5305bf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985578.399129:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff8b11433ea200/0xa0dd3253da5305bf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985578.399166:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114305df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973697408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788985578.399237:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985578.399295:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8b11410b1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788985578.399542:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973697408 00000100:00100000:1.0:1788985578.399550:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973697408 00000100:00100000:1.0:1788985578.399633:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:1.0:1788985578.399643:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126cda7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+23:6511:x1875885973697408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985578.399656:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985578.399669:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b12617ea400/0xa0dd3253da5305c6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0dd3253da5305bf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985578.399692:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b12617ea400/0xa0dd3253da5305c6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0dd3253da5305bf expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985578.399702:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b12617ea400/0xa0dd3253da5305c6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0dd3253da5305bf expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985578.399712:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b12617ea400, rc 0) 00000100:00100000:1.0:1788985578.399770:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126cda7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+24:6511:x1875885973697408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985578.399779:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:3.0:1788985578.399840:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114305df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:18d53938-9833-4a4f-b2bc-80656579f00f:6511:1875885973697408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788985578.399889:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff8b11433ea200/0xa0dd3253da5305bf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5305c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985578.399904:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff8b11433ea200/0xa0dd3253da5305bf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0dd3253da5305c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788985578.399993:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788985578.400000:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff8b11433ea200/0xa0dd3253da5305bf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5305c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985578.400011:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff8b11433ea200/0xa0dd3253da5305bf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0dd3253da5305c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985578.530151:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985578.568151:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788985578.568235:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788985578.568285:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788985578.568319:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953233920 00000100:00100000:1.0:1788985578.568333:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953233920 00000100:00100000:1.0:1788985578.568408:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953233792 00000100:00100000:1.0:1788985578.568412:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953233792 00000100:00100000:1.0:1788985578.568441:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1821 00000100:00100000:1.0:1788985578.568453:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2391:x1875885953233920:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788985578.568565:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2391:x1875885953233920:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 114us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985578.568574:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1821 00000100:00100000:1.0:1788985578.568613:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1822 00000100:00100000:1.0:1788985578.568620:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:434c316c-c59b-49ac-917b-d6d87006b1b1+6:2391:x1875885953233792:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788985578.568646:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:434c316c-c59b-49ac-917b-d6d87006b1b1+6:2391:x1875885953233792:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985578.568652:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1822 00000100:00080000:1.0:1788985578.568675:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788985578.568680:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788985578.569405:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953233664 00000100:00100000:3.0:1788985578.569414:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953233664 00000100:00100000:3.0:1788985578.569463:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 923 00000100:00100000:3.0:1788985578.569472:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126cda7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2391:x1875885953233664:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788985578.569529:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126cda7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2391:x1875885953233664:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 58us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985578.569536:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 923 00000100:00100000:1.0:1788985578.725092:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788985578.725128:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973697536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985578.725226:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985578.725326:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973697536 00000100:00100000:1.0:1788985578.725336:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973697536 00000100:00100000:1.0:1788985578.725410:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:1.0:1788985578.725422:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973697536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985578.725460:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788985578.725514:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973697536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985578.725521:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00080000:1.0:1788985578.725545:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985578.725589:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973697536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985578.727695:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875885973697792:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.727780:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985578.727830:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875885973698304:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.727862:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985578.727893:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875885973698816:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.727917:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985578.727981:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788985578.727988:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973697920:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.728018:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985578.728040:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875885973698432:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.728236:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985578.728259:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875885973698944:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.728282:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985578.728379:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973697792 00000100:00100000:0.0:1788985578.728390:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973697792 00000100:00100000:0.0:1788985578.728438:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973698304 00000100:00100000:0.0:1788985578.728441:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973698304 00000100:00100000:0.0:1788985578.728471:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973698816 00000100:00100000:0.0:1788985578.728474:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973698816 00000100:00100000:0.0:1788985578.728499:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973698432 00000100:00100000:0.0:1788985578.728501:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973698432 00000100:00100000:0.0:1788985578.728517:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973698944 00000100:00100000:0.0:1788985578.728519:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973698944 00000100:00100000:0.0:1788985578.728533:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823 00000100:00100000:0.0:1788985578.728541:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875885973697792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.728600:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875885973697792:12345-0@lo:400:kworker.0 Request processed in 59us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985578.728608:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823 00000100:00100000:0.0:1788985578.728626:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:0.0:1788985578.728632:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875885973698304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.728657:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875885973698304:12345-0@lo:400:kworker.0 Request processed in 25us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985578.728663:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:0.0:1788985578.728674:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:0.0:1788985578.728679:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114338ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875885973698816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.728699:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114338ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875885973698816:12345-0@lo:400:kworker.0 Request processed in 20us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985578.728704:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00100000:0.0:1788985578.728713:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826 00000100:00100000:0.0:1788985578.728718:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875885973698432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.728737:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875885973698432:12345-0@lo:400:kworker.0 Request processed in 19us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985578.728743:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826 00000100:00100000:0.0:1788985578.728751:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:0.0:1788985578.728756:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875885973698944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.728787:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875885973698944:12345-0@lo:400:kworker.0 Request processed in 31us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985578.728793:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00100000:0.0:1788985578.728824:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973697920 00000100:00100000:0.0:1788985578.728827:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973697920 00000100:00100000:0.0:1788985578.728850:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1788985578.729592:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973697920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.729645:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973697920:12345-0@lo:400:kworker.0 Request processed in 789us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985578.729652:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00080000:0.0:1788985578.729689:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788985578.729694:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985578.729710:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875885973698048:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.729740:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985578.729783:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973698560:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.729807:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985578.729822:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973699072:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.729842:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985578.730093:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973698560 00000100:00100000:1.0:1788985578.730100:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973698560 00000100:00100000:1.0:1788985578.730148:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973699072 00000100:00100000:1.0:1788985578.730151:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973699072 00000100:00100000:1.0:1788985578.730178:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1788985578.730186:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973698560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985578.730236:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973698560:12345-0@lo:400:kworker.0 Request processed in 52us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985578.730255:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1788985578.730269:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1788985578.730275:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b127d2a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973699072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985578.730303:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b127d2a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973699072:12345-0@lo:400:kworker.0 Request processed in 28us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985578.730309:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00080000:1.0:1788985578.730682:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985578.730686:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985578.730697:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973698048 00000100:00100000:1.0:1788985578.730701:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973698048 00000100:00100000:1.0:1788985578.730733:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:1.0:1788985578.730739:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875885973698048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985578.730774:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875885973698048:12345-0@lo:400:kworker.0 Request processed in 35us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985578.730780:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:0.0:1788985578.730990:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875885973698048:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.731005:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973698560:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.731017:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973699072:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.731058:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788985578.731069:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973697664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788985578.731109:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985578.731161:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973698176:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.731183:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985578.733816:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114338e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973698688:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.733915:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985578.733998:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973697664 00000100:00100000:0.0:1788985578.734009:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973697664 00000100:00100000:0.0:1788985578.734077:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973698176 00000100:00100000:0.0:1788985578.734081:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973698176 00000100:00100000:0.0:1788985578.734102:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1788985578.734111:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973697664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788985578.734164:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788985578.734241:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875885973697664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985578.734249:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1788985578.734272:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:0.0:1788985578.734278:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973698176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985578.736660:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973698688 00000100:00100000:1.0:1788985578.736680:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973698688 00000100:00100000:1.0:1788985578.736769:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1788985578.736781:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973698688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985578.736898:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973698688:12345-0@lo:400:kworker.0 Request processed in 120us (2983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985578.736906:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00080000:1.0:1788985578.736951:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985578.737126:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973698176:12345-0@lo:400:kworker.0 Request processed in 33us (3126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985578.737136:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:0.0:1788985578.737232:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973697920:0@lo:400:kworker.0 00010000:00080000:0.0:1788985578.737254:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b1277ee7b80 x1875885973698432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788985578.737266:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875885973698432:0@lo:400:kworker.0 00010000:00080000:0.0:1788985578.737280:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b114338fb80 x1875885973698944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788985578.737309:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875885973698944:0@lo:400:kworker.0 00000100:00100000:2.0:1788985578.737593:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875885973697664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788985578.737609:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973698176:0@lo:400:kworker.0 00000100:00100000:2.0:1788985578.737623:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973698688:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.737701:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875885973697792:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.737712:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875885973698304:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.737723:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114338c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875885973698816:0@lo:400:kworker.0 00000100:00100000:0.0:1788985578.740272:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114485ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973699200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788985578.740392:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985578.740570:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973699200 00000100:00100000:3.0:1788985578.740581:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973699200 00000100:00100000:3.0:1788985578.740656:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:3.0:1788985578.740669:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b12412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973699200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788985578.740701:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788985578.740759:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b12412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973699200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985578.740767:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1788985578.741195:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114485ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973699200:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788985579.559794:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985580.578966:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985581.271309:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788985581.292065:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953234048 00000100:00100000:2.0:1788985581.292082:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953234048 00000100:00100000:2.0:1788985581.292167:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:2.0:1788985581.292179:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:434c316c-c59b-49ac-917b-d6d87006b1b1+6:6164:x1875885953234048:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788985581.292223:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985581.292251:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b11433ebe00/0xa0dd3253da530595 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xbe077727b9e171ef expref: 6 pid: 9790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985581.292269:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b1143311300) 00010000:00010000:2.0:1788985581.292280:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985581.292346:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:434c316c-c59b-49ac-917b-d6d87006b1b1+5:6164:x1875885953234048:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 170us (21047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985581.292354:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00080000:2.0:1788985581.292385:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788985581.598102:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985581.792474:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114485d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973699328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788985581.792546:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985581.792657:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973699328 00000100:00100000:3.0:1788985581.792665:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973699328 00000100:00100000:3.0:1788985581.792723:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:3.0:1788985581.792732:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973699328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788985581.792764:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788985581.792805:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875885973699328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985581.792813:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00080000:1.0:1788985581.792867:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985581.792898:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114485d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875885973699328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788985581.793206:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788985581.793215:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973699456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788985581.793239:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985581.793278:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973699456 00000100:00100000:0.0:1788985581.793284:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973699456 00000100:00080000:3.0:1788985581.793351:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985581.793472:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1788985581.793482:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114485ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973699456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788985581.793495:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788985581.793542:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114485ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973699456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985581.793549:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1788985581.793974:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973699456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788985581.947370:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788985581.947416:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953234176 00000100:00100000:1.0:1788985581.947427:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953234176 00000100:00100000:1.0:1788985581.947481:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:1.0:1788985581.947492:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1142ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:434c316c-c59b-49ac-917b-d6d87006b1b1+5:35200:x1875885953234176:12345-192.168.202.6@tcp:101:chmod.0 00010000:00010000:1.0:1788985581.947511:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985581.947533:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb800/0xa0dd3253da5305cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe077727b9e171fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985581.947586:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea000/0xa0dd3253da5305d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985581.947599:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea000/0xa0dd3253da5305d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985581.947610:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea000/0xa0dd3253da5305d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788985581.947653:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788985581.947657:0:6514:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788985581.947679:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea000/0xa0dd3253da5305d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985581.947702:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617eb800/0xa0dd3253da5305cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xbe077727b9e171fd expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985581.947717:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b12617ea000/0xa0dd3253da5305d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xbe077727b9e171fd expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985581.947731:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b1243922c00) 00010000:00010000:1.0:1788985581.947734:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788985581.947737:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b12617ea000, rc 0) 00000100:00100000:1.0:1788985581.947786:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1142ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:434c316c-c59b-49ac-917b-d6d87006b1b1+6:35200:x1875885953234176:12345-192.168.202.6@tcp:101:chmod.0 Request processed in 297us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985581.947793:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:2.0:1788985581.951507:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788985581.951676:0:10354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953234304 00000100:00100000:0.0:1788985581.951685:0:10354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953234304 00000100:00100000:0.0:1788985581.951749:0:10354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:0.0:1788985581.951761:0:10354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114305ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:434c316c-c59b-49ac-917b-d6d87006b1b1+6:35200:x1875885953234304:12345-192.168.202.6@tcp:101:chmod.0 00010000:00010000:0.0:1788985581.951780:0:10354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985581.951800:0:10354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8c00/0xa0dd3253da5305db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe077727b9e17204 expref: -99 pid: 10354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.951867:0:10354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e9000/0xa0dd3253da5305e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.951880:0:10354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e9000/0xa0dd3253da5305e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.951892:0:10354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e9000/0xa0dd3253da5305e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.951906:0:10354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8200/0xa0dd3253da5305e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.951913:0:10354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8200/0xa0dd3253da5305e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.951920:0:10354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8200/0xa0dd3253da5305e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.951998:0:10354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e9000/0xa0dd3253da5305e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952007:0:10354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e9000/0xa0dd3253da5305e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952013:0:10354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e9000/0xa0dd3253da5305e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952030:0:10354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12677e9000 already unused, calling callback (ffffffffc19fa4f0) 00010000:00010000:0.0:1788985581.952034:0:10354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e9000/0xa0dd3253da5305e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952051:0:10354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e9000/0xa0dd3253da5305e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952191:0:10354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b1243922c00) 00010000:00010000:0.0:1788985581.952195:0:10354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985581.952202:0:10354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e9000/0xa0dd3253da5305e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952209:0:10354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e9000/0xa0dd3253da5305e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952222:0:10354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8200/0xa0dd3253da5305e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952229:0:10354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8200/0xa0dd3253da5305e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952235:0:10354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8200/0xa0dd3253da5305e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952240:0:10354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b12677e8200 already unused, calling callback (ffffffffc19fa4f0) 00010000:00010000:0.0:1788985581.952243:0:10354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8200/0xa0dd3253da5305e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952249:0:10354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8200/0xa0dd3253da5305e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952257:0:10354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8b11422d1d00) 00010000:00010000:0.0:1788985581.952260:0:10354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985581.952262:0:10354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8200/0xa0dd3253da5305e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952278:0:10354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8200/0xa0dd3253da5305e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952308:0:10354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8c00/0xa0dd3253da5305db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xbe077727b9e17204 expref: 7 pid: 10354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952318:0:10354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b1243922c00) 00010000:00010000:0.0:1788985581.952320:0:10354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985581.952324:0:10354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b12677e8c00/0xa0dd3253da5305db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xbe077727b9e17204 expref: 7 pid: 10354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985581.952332:0:10354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b12677e8c00, rc 0) 00000100:00100000:0.0:1788985581.952386:0:10354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114305ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:434c316c-c59b-49ac-917b-d6d87006b1b1+6:35200:x1875885953234304:12345-192.168.202.6@tcp:101:chmod.0 Request processed in 627us (888us total) trans 0 rc 301/301 00000100:00100000:0.0:1788985581.952393:0:10354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:3.0:1788985582.302138:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1277e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973699584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788985582.302201:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985582.303713:0:13641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973699584 00000100:00100000:2.0:1788985582.303726:0:13641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973699584 00000100:00100000:2.0:1788985582.303792:0:13641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:2.0:1788985582.303801:0:13641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114485d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973699584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788985582.303836:0:13641:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788985582.307137:0:13641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114485d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875885973699584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3327us (4925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985582.307152:0:13641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:0.0:1788985582.309030:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1277e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875885973699584:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788985582.627881:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788985583.249636:0:58737:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-sec test_22: @@@@@@ FAIL: cannot chmod mapped_trusted_admin:0:c0:0:003 00010000:00010000:1.0:1788985583.647318:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985583.670825:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788985583.672345:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953234432 00000100:00100000:2.0:1788985583.672359:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953234432 00000100:00100000:2.0:1788985583.672426:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 924 00000100:00100000:2.0:1788985583.672438:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126cda5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2390:x1875885953234432:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788985583.672543:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126cda5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f2cda2-a314-4eec-bbee-9cd3d6a905e4+10:2390:x1875885953234432:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 107us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985583.672568:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 924 00000100:00100000:0.0:1788985583.673047:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788985583.675610:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953234560 00000100:00100000:2.0:1788985583.675625:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953234560 00000100:00100000:2.0:1788985583.675722:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1829 00000100:00100000:2.0:1788985583.675733:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1142ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:434c316c-c59b-49ac-917b-d6d87006b1b1+6:2390:x1875885953234560:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788985583.675833:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1142ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:434c316c-c59b-49ac-917b-d6d87006b1b1+6:2390:x1875885953234560:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 102us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985583.675841:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1829 00000100:00080000:3.0:1788985583.677470:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985583.679596:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788985583.679686:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885953234688 00000100:00100000:1.0:1788985583.679694:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885953234688 00000100:00100000:1.0:1788985583.679764:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1830 00000100:00100000:1.0:1788985583.679772:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1142ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2390:x1875885953234688:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788985583.679851:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1142ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:434c316c-c59b-49ac-917b-d6d87006b1b1+5:2390:x1875885953234688:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 80us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985583.679857:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1830 00000100:00080000:3.0:1788985583.679904:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788985583.838423:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973699712:0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.838513:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985583.838570:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973700224:0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.838597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985583.838616:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973700736:0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.838638:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985583.838672:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973701248:0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.838694:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985583.838719:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788985583.838725:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875885973700096:0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.838749:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985583.838768:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973700608:0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.838786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985583.838802:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973701120:0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.838820:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985583.838850:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973699968:0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.838873:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985583.838890:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875885973700480:0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.838945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985583.838964:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875885973700992:0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.838985:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985583.840361:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875885973699840:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.840422:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985583.840452:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875885973700352:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.840486:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985583.840506:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1142ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875885973700864:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.840527:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985583.840537:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b114485ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973701376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788985583.840558:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985583.840599:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973700096 00000100:00100000:3.0:1788985583.840606:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973700096 00000100:00100000:3.0:1788985583.840639:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973700480 00000100:00100000:3.0:1788985583.840641:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973700480 00000100:00100000:3.0:1788985583.840662:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973700992 00000100:00100000:3.0:1788985583.840674:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973700992 00000100:00100000:3.0:1788985583.840692:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973699840 00000100:00100000:3.0:1788985583.840694:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973699840 00000100:00100000:3.0:1788985583.840704:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973700352 00000100:00100000:3.0:1788985583.840706:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973700352 00000100:00100000:3.0:1788985583.840716:0:9790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973700864 00000100:00100000:3.0:1788985583.840718:0:9790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973700864 00000100:00100000:3.0:1788985583.840732:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:3.0:1788985583.840740:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277c72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875885973700096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.840789:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277c72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875885973700096:12345-0@lo:400:kworker.0 Request processed in 49us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985583.840796:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:3.0:1788985583.840814:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:3.0:1788985583.840819:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875885973700480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.840846:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875885973700480:12345-0@lo:400:kworker.0 Request processed in 27us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985583.840851:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000100:00100000:3.0:1788985583.840862:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:3.0:1788985583.840867:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875885973700992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.840894:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875885973700992:12345-0@lo:400:kworker.0 Request processed in 28us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985583.840914:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00100000:3.0:1788985583.840948:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834 00000100:00100000:3.0:1788985583.840955:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114485e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875885973699840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.840988:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114485e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875885973699840:12345-0@lo:400:kworker.0 Request processed in 34us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985583.840994:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834 00010000:00080000:0.0:1788985583.847361:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b1142ff6680 x1875885973700992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788985583.847381:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875885973700992:0@lo:400:kworker.0 00010000:00080000:0.0:1788985583.847434:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b1142ff5c00 x1875885973700480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788985599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788985583.847443:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875885973700480:0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.848706:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973699712 00000100:00100000:0.0:1788985583.848717:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973699712 00000100:00100000:0.0:1788985583.848780:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:0.0:1788985583.848803:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b126cda5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+24:3640:x1875885973699712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.848884:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b126cda5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18d53938-9833-4a4f-b2bc-80656579f00f+24:3640:x1875885973699712:12345-0@lo:400:kworker.0 Request processed in 83us (10372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985583.848891:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:0.0:1788985583.848959:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973700224 00000100:00100000:0.0:1788985583.848964:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973700224 00000100:00100000:0.0:1788985583.848990:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973699968 00000100:00100000:0.0:1788985583.848994:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973699968 00000100:00100000:0.0:1788985583.849029:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1788985583.849036:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1142ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973700224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.849073:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1142ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973700224:12345-0@lo:400:kworker.0 Request processed in 37us (10475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985583.849079:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1788985583.849092:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1788985583.849098:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973699968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.849133:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875885973699968:12345-0@lo:400:kworker.0 Request processed in 34us (10259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985583.849138:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1788985583.849157:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973700736 00000100:00100000:0.0:1788985583.849160:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973700736 00000100:00100000:0.0:1788985583.849183:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973701248 00000100:00100000:0.0:1788985583.849186:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973701248 00000100:00100000:0.0:1788985583.849211:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973700608 00000100:00100000:0.0:1788985583.849214:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973700608 00000100:00100000:0.0:1788985583.849227:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973701120 00000100:00100000:0.0:1788985583.849230:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973701120 00000100:00100000:0.0:1788985583.849242:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1788985583.849248:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1142ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973700736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.849291:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1142ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973700736:12345-0@lo:400:kworker.0 Request processed in 42us (10651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985583.849297:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1788985583.849309:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1788985583.849315:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973701248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.849341:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973701248:12345-0@lo:400:kworker.0 Request processed in 27us (10646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985583.849347:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1788985583.849358:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1788985583.849364:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973700608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.849389:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973700608:12345-0@lo:400:kworker.0 Request processed in 26us (10602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985583.849407:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1788985583.849418:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1788985583.849424:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1277c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973701120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985583.849448:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1277c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875885973701120:12345-0@lo:400:kworker.0 Request processed in 25us (10627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985583.849453:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1788985583.850064:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:3.0:1788985583.850072:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875885973700352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.850115:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875885973700352:12345-0@lo:400:kworker.0 Request processed in 45us (9627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985583.850121:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:3.0:1788985583.850133:0:9790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:3.0:1788985583.850141:0:9790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875885973700864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.850167:0:9790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875885973700864:12345-0@lo:400:kworker.0 Request processed in 27us (9640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985583.850174:0:9790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00100000:3.0:1788985583.850208:0:9607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973701376 00000100:00100000:3.0:1788985583.850213:0:9607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973701376 00000100:00100000:3.0:1788985583.850245:0:9607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:3.0:1788985583.850251:0:9607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973701376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788985583.850281:0:9607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788985583.850315:0:9607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973701376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (9755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985583.850321:0:9607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00080000:3.0:1788985583.850340:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788985583.850343:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788985583.850346:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788985583.850348:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788985583.850388:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875885973699840:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.852097:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875885973700352:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.852115:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875885973700864:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.852136:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b114485ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973701376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788985583.852218:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875885973700096:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.852230:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973700608:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.852239:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875885973701120:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.852248:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:18d53938-9833-4a4f-b2bc-80656579f00f:3640:1875885973699712:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.852257:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973700224:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.852266:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973700736:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.852277:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973701248:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.852378:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788985583.852388:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1247c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973701504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788985583.852436:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985583.852474:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973701504 00000100:00100000:3.0:1788985583.852480:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973701504 00000100:00100000:3.0:1788985583.852515:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1788985583.852524:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b1247c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973701504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788985583.852553:0:6519:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788985583.852597:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b1247c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875885973701504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985583.852604:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1788985583.852635:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1247c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875885973701504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788985583.853825:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1142ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875885973699968:0@lo:400:kworker.0 00000100:00100000:3.0:1788985583.860333:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788985583.860357:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8b1247c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973701632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788985583.860451:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985583.860770:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885973701632 00000100:00100000:0.0:1788985583.860780:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885973701632 00000100:00100000:0.0:1788985583.860836:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1788985583.860846:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8b114485ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973701632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985583.860871:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788985583.860965:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8b114485ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875885973701632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985583.860981:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1788985583.861075:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8b1247c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875885973701632:0@lo:13:osp-pre-1-0.0 Debug log: 3339 lines, 3339 kept, 0 dropped, 0 bad.